-- Logs begin at Tue 2022-09-13 14:49:35 UTC, end at Tue 2022-09-13 15:50:50 UTC. -- Sep 13 15:21:21.686722 dv-cinder-857434-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 15:21:21.695877 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 15:21:21 2022] *** Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: nodename: dv-cinder-857434-2-iscsi Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: machine: x86_64 Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: clock source: unix Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: pcre jit disabled Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: detected number of CPU cores: 4 Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: current working directory: / Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: detected binary path: /usr/bin/uwsgi-core Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: your processes number limit is 47680 Sep 13 15:21:21.697791 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: your memory page size is 4096 bytes Sep 13 15:21:21.698629 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: detected max file descriptor number: 2048 Sep 13 15:21:21.698629 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: lock engine: pthread robust mutexes Sep 13 15:21:21.698629 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: thunder lock: enabled Sep 13 15:21:21.698629 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 15:21:21.698629 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 15:21:21.737370 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: Python main interpreter initialized at 0x559fe061a9c0 Sep 13 15:21:21.737370 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: python threads support enabled Sep 13 15:21:21.737370 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: your server socket listen backlog is limited to 100 connections Sep 13 15:21:21.737370 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: your mercy for graceful operations on workers is 90 seconds Sep 13 15:21:21.737805 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 15:21:21.737805 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: *** Operational MODE: preforking *** Sep 13 15:21:21.738057 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: *** uWSGI is running in multiple interpreter mode *** Sep 13 15:21:21.738057 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: spawned uWSGI master process (pid: 105480) Sep 13 15:21:21.738276 dv-cinder-857434-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 15:21:21.739759 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: spawned uWSGI worker 1 (pid: 105481, cores: 1) Sep 13 15:21:21.739759 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: spawned uWSGI worker 2 (pid: 105482, cores: 1) Sep 13 15:21:21.739759 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 15:21:22.391165 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 15:21:22.391820 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 15:21:23.457669 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:21:23.457669 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: from cryptography.utils import int_from_bytes Sep 13 15:21:23.458428 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:21:23.458428 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: from cryptography.utils import int_from_bytes Sep 13 15:21:23.459178 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:21:23.459178 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: from cryptography.utils import int_from_bytes Sep 13 15:21:23.459664 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:21:23.459664 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: from cryptography.utils import int_from_bytes Sep 13 15:21:25.910542 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:21:25.911211 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:21:25.911297 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:21:25.911297 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:21:25.911697 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:21:25.911771 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:21:25.911835 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:21:25.911900 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:21:25.911971 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:21:25.912128 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:21:25.912261 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.912538 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.912667 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.912821 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.912921 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.913168 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.913298 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.913456 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.913552 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.913816 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.913955 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.914090 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.914229 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.914468 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.914614 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.914790 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.914917 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.915068 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.915151 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.915340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.915488 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.915653 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.915845 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-2-iscsi {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.915934 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.916022 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-2-iscsi {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.916230 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.916330 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.916538 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.916673 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.916843 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.916936 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.917144 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.917233 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.917443 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.917531 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.917756 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.917843 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.918058 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.918290 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.918598 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.918759 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.918899 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.919050 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.919197 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.919348 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.919503 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.919689 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.919899 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.920058 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.920145 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.920333 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.920465 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.920609 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.920782 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.920913 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.921074 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.921216 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.921416 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.921712 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.921819 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.922123 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-2-iscsi {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.922225 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-2-iscsi {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.922437 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.922531 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.922743 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.922877 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.923055 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.923153 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.923462 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.923608 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.923760 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.923857 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.924072 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.924158 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.924386 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.924478 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.924706 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.924802 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.925007 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.925094 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.925329 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.925415 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.925642 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.925729 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.925955 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.926048 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.926300 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.926395 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.926594 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.926747 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.926902 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.927026 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.927200 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.927286 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.927514 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.927608 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.927809 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.927896 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.928113 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.928208 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.928355 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.928455 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.928640 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.928730 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.928952 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.929043 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.929268 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.929360 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.929584 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.929672 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.929829 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.929921 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.930074 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.930220 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.930408 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.930506 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.930724 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.930809 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.931028 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.931118 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.931332 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.931429 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.931632 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.931714 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.931933 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.932015 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.932231 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.932322 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.932533 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.932615 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.932830 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.932920 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.933132 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.933227 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.933446 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.933537 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.933758 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.933848 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.934074 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.934195 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.934398 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.934482 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.934715 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.934811 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.935105 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.935197 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.935354 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.935444 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.935657 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.935747 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.935991 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.936085 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.936305 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.936398 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.936610 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.936703 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.936959 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.937079 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.937283 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.937371 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.937629 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.937721 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.937892 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.937980 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.938221 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.938306 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.938537 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.938621 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.938859 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.938943 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.939154 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.939235 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.939402 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.939497 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.939699 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.939781 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.939995 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.940087 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.940311 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.940402 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.940609 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.940692 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.940913 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.941005 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.941212 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.941304 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.941509 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.941590 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.941807 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.941890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.942166 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.942340 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.942422 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.942498 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.942720 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.942804 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.943021 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.943111 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.943318 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.943400 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.943617 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.943705 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.943917 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.944003 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.944218 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.944302 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.944514 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.944603 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.944827 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.944916 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.945142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.945225 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.945443 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.945532 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.945738 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.945829 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.946040 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.946197 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.946366 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.946449 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.946684 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.946775 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.946983 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.947066 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.947283 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.947368 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.947597 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.947681 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.947897 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.947982 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.948196 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.948278 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.948506 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.948590 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.948808 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.948905 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.949108 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.949198 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.949421 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.949505 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.949716 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.949806 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.950015 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.950153 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.950352 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.950446 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.950656 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.950738 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.950953 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.951046 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.951250 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.951333 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.951546 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.951638 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.951843 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.951933 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.952138 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.952219 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.952434 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.952515 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.952802 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.952892 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.953096 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.953192 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.953370 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.953455 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.953704 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.953808 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.953993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.954078 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.954317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.954400 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.954618 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.954703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.954934 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.955017 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:21:25.955260 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.955354 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.955589 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.955672 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.955925 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.956007 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.956237 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.956319 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.956562 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.956652 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.956892 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.956974 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.957204 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.957303 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.957515 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.957599 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.957826 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.957917 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.958173 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.958272 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.958486 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.958578 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.958798 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.958880 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.959103 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.959194 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.959419 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.959527 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.959732 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.959820 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.960054 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.960146 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.960368 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.960450 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.960683 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.960816 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.961002 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.961094 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.961311 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.961403 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.961627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.961709 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.961953 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.962045 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.962300 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.962384 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.962613 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.962695 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.962954 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.963041 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.963298 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.963381 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.963611 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.963700 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.963929 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.964054 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.964246 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.964329 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.964555 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.964637 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.964861 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.964945 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.965170 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.965252 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.965507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.965589 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.965819 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.965902 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.966152 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.966251 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.966471 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.966569 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.966781 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.966863 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.967098 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.967219 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.967408 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.967533 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.967712 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.967794 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.968021 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.968103 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.968393 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969166 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969257 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969344 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969431 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969509 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969594 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969680 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969760 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.969931 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.970016 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.970279 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.970382 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.970597 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.970683 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.970918 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.971001 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.971229 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.971325 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.971535 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.971625 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.971839 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.971922 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.972142 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.972233 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.972444 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.972527 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.972747 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.972836 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.973047 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.973143 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.973349 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.973432 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.973672 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.973763 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.973975 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.974071 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.974330 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.974415 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.974637 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.974721 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.974946 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.975032 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.975255 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.975336 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.975562 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.975651 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.975867 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.975952 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.976171 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.976254 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.976475 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.976558 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.976779 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.976870 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.977081 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.977504 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.977737 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.977830 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.978041 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.978208 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.978376 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.978471 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.978675 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.978767 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.978981 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.979065 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.979294 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.979377 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.979602 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.979693 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.979913 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.979995 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.980218 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.980301 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.980527 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.980617 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.980839 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.980923 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.981147 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.981236 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.981457 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.981550 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.981764 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.981846 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.982116 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.982203 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.982425 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.982509 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.982746 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.982837 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.983065 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.983149 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.983381 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.983465 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.983691 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.983866 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.984135 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.984352 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.984474 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.984699 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.984784 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.985077 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.985264 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.985385 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.985689 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.985773 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.986007 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.986144 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.986339 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.986440 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.986635 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.986723 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.986937 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.987020 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.987247 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.987348 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.987552 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.987641 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.987855 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.987945 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.988158 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.988250 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.988462 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.988552 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.988769 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.988854 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.989081 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.989174 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.989388 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.989480 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.989729 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.989817 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.990036 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.990142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.990382 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.990465 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.990692 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.990783 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.991005 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.991089 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.991313 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.991395 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.991621 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.991704 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.991930 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.992024 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.992239 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.992321 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.992550 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.992633 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.992857 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.992942 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.993168 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.993253 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.993476 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.993567 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.993782 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.993864 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.994091 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.994234 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.994425 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.994525 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.994738 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.994828 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.995046 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.995138 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.995365 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.995459 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.995671 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.995755 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.995987 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.996070 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.996303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.996393 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.996615 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.996698 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.996928 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.997016 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.997236 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.997328 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.997545 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.997634 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.997853 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.997935 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.998181 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.998270 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.998495 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.998577 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.998801 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.998886 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.999115 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.999206 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.999465 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.999558 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.999781 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:25.999864 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.000100 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.000195 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.000412 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.000502 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.000734 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.000819 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.001046 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.001130 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.001364 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.001447 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.001671 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.001774 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.001985 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.002078 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.002344 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.002426 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.002667 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.002767 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.002977 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.003060 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.003284 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.003367 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.003602 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.003697 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.003907 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.004039 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.004211 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.004303 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.004521 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.004615 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.004829 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.004912 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.005137 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.005220 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.005445 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.005535 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.005750 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.005833 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.006060 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.006192 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.006394 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.006479 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.006698 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.006830 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.006998 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.007088 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.007308 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.007392 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.007613 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.007695 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.007919 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.008021 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.008229 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.008315 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.008547 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.008628 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.008852 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.008936 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.009155 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.009240 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.009476 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.009559 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.009778 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.009873 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.010079 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.010224 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.010404 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.010488 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.010705 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.010807 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.011023 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.011106 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.011331 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.011416 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.011632 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.011724 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.011945 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.012035 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.012263 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.012347 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.012565 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.012655 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.012871 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.012953 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.013179 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.013261 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.013489 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.013572 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.013805 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.013887 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.014157 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.014245 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.014442 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.014582 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.014749 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.014833 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.015131 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.015218 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.015465 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.015597 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.015926 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.016017 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.016249 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.016338 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.016559 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.016643 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.016870 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.016952 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.017179 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.017270 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.017484 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.017568 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.017795 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.017877 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.018126 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.018235 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.018441 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.018707 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.018792 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.019042 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.019126 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.019358 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.019623 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.019718 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.019960 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.020051 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.020280 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.020440 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.020605 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.020697 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.020935 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.021017 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.021247 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.021340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.021552 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.021650 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.021861 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.021945 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.022188 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.022286 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.022496 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.022589 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.022807 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.022891 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.023112 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.023194 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.023421 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.023513 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.023725 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.023808 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.024029 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.024111 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.024330 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.024414 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.024634 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.024715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.024937 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.025020 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.025241 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.025325 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.025548 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.025632 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.025848 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.025936 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.026176 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.026263 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.026485 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.026569 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.026789 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.026872 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.027097 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.027190 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.027400 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.027490 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.027701 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.027798 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028003 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028138 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028307 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028409 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028609 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028706 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028912 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.028997 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.029264 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.029349 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.029574 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.029670 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.029893 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.029975 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.030247 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.030335 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.030575 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.030704 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.030904 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.030990 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.031208 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.031317 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.031512 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.031653 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.031822 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.031964 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.032128 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.032275 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.032430 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.032586 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.032739 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.032900 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.033045 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.033211 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.033357 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.033520 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.033662 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.033835 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.033963 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.034174 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.034285 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.034489 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.034582 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.034804 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.034910 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.035108 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.035201 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.035418 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.035503 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.035725 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.035809 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.036038 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.036126 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.036344 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.036428 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.036645 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.036736 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.036947 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.037031 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.037243 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.037344 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.037554 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.037638 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.037853 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.037937 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.038181 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.038290 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.038487 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.038587 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.038789 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.038890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.039094 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.039183 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.039394 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.039492 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.039697 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.039785 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040002 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040089 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040401 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040603 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040698 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040908 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.040997 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.041206 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.041304 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.041505 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.041595 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.041810 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.041897 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.042135 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.042225 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.042447 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.042535 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.042748 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.042836 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.043054 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.043141 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.043356 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.043444 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.043659 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.043748 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.043960 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.044048 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.044263 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.044351 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.044563 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.044650 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.044865 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.044952 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.045164 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.045253 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.045464 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.045628 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.045768 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.045867 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.046070 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.046188 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.046440 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.046581 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.046747 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.046883 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.047048 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.047193 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.047351 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.047521 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.047694 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.047834 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.047996 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.048141 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.048352 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.048452 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.048658 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.048761 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.048970 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.049054 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.049287 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.049372 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.049594 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.049713 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.049902 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.050024 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.050236 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.050394 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.050541 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.050720 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.050855 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.051033 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.051165 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.051346 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.051477 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.051664 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.051782 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.051977 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.052083 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.052298 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.052396 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.052612 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.052700 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.052928 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.053016 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.053234 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.053325 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.053544 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.053635 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.053870 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.053965 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.054214 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.054314 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.054532 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.054620 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.054838 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.054933 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.055145 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.055234 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.055460 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.055550 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.055765 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.055860 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.056070 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.056194 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.056381 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.056640 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.056736 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.056956 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.057047 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.057267 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.057351 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.057578 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.057662 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.057883 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.057965 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.058216 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.058316 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.058531 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.058620 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.058837 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.058926 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.059147 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.059232 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.059457 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.059542 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.059761 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.059846 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.060065 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.060160 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.060365 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.060449 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.060675 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.060759 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.060979 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.061078 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.061291 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.061403 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.061601 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.061716 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.061933 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.062135 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.062282 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.062378 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.062668 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.062753 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.062978 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.063071 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.063295 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.063378 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.063605 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.063688 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.063906 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.063990 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.064213 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.064328 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.064534 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.064625 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.064856 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.064942 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.065164 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.065259 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.065525 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.065607 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.065830 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.065916 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.066159 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.066247 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.066490 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.066575 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.066796 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.066880 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.067100 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.067183 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.067405 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.067497 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.067727 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.067812 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.068035 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.068118 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.068343 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.068435 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.068650 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.068760 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.068981 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.069074 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.069289 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.069383 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.069614 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.069764 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.070033 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.070148 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.070378 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.070472 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.070685 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.070768 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.071023 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.071136 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.071352 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.071445 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.071662 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.071755 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.071979 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.072070 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.072290 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.072373 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.072613 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.072705 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.072932 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.073021 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.073242 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.073325 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.073554 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.073638 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.073857 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.074020 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.074201 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.074290 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.074524 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.074609 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.074834 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.074918 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.075157 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.075293 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.075465 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.075553 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.075789 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.075874 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.076105 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.076198 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.076429 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.076514 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.076771 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.076854 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.077075 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.077168 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.077383 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.077504 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.077738 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.077824 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.078044 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.078175 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.078374 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.078460 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.078698 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.078786 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.079005 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.079098 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.079318 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.079402 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.079628 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.079712 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.079937 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.080030 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.080242 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.080325 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.080545 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.080629 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.080854 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.080938 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.081156 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.081238 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.081457 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.081541 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.081763 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.081848 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.082084 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.082202 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.082417 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.082514 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.082722 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.082807 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.083042 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.083124 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.083353 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.083443 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.083659 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.083751 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.083962 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.084046 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.084266 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.084358 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.084578 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.084661 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.084884 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.084967 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.085189 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.085348 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.085497 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.085581 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.085827 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.085910 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.086151 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.086250 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.086476 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.086561 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.086800 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.086883 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.087203 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.087292 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.087417 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.087501 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.087733 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.087828 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.088055 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.088141 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.088359 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.088442 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.088664 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.088795 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.088972 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.089060 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.089274 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.089358 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.089577 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.089660 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.089879 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.089973 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.090211 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.090297 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.090513 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.090615 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.090816 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.090900 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.091111 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.091194 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.091419 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.091510 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.091719 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.091801 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.092019 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.092111 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.092324 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.092416 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.092624 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.092707 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.092927 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.093010 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.093254 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.093357 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.093567 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.093650 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.093873 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.093956 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.094204 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.094294 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.094513 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.094597 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.094832 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.094917 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.095145 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.095229 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.095457 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.095540 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.095769 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.095852 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.096078 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.096161 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.096389 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.096474 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.096701 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.096783 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.097010 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.097093 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.097315 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.097399 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.097627 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.097768 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.097938 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.098024 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.098275 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.098373 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.098584 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.098791 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.098918 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.099120 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.099204 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.099433 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.099518 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.099745 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.100017 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.100101 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.100348 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.100431 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.100653 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.100748 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.100960 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.101043 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.101268 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.101357 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.101576 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.101661 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.101883 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.101966 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.102565 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.102657 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.102880 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.102966 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.103194 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.103277 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.103505 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.103596 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.103826 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.103910 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.104148 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.104230 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.104463 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.104559 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.104776 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.104860 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.105097 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.105180 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.105413 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.105506 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.105718 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.105802 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.106030 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.106126 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.106367 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.106452 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.106680 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.106765 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.106989 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.107073 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.107296 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.107388 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.107607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.107691 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.107917 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.108013 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.108223 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.108306 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.108527 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.108609 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.108940 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.109097 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.109231 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.109316 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.109541 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.109623 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.109854 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.109948 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.110193 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.110283 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.110508 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.110602 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.110822 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.110907 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.111138 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.111223 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.111461 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.111660 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.111780 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.111977 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.112097 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.112308 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.112415 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.112634 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.112943 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.113028 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.113265 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.113350 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.113581 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.113663 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.113906 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.113999 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.114239 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.114326 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.114545 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.114708 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.114853 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.114937 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.115159 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.115251 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.115462 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.115555 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.115769 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.115855 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.116076 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.116167 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.116378 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.116470 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.116679 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.116770 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.116989 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.117079 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.117301 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.117519 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.117604 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.117867 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.117951 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.118212 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.118322 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.118538 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.118761 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.118845 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.119109 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.119195 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.119428 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.119514 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.119755 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.119839 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.120059 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.120148 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.120367 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.120464 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.120679 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.120762 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.120985 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.121067 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.121289 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.121373 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.121593 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.121675 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.121900 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.121993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.122236 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.122331 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.122542 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.122627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.122849 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.122940 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.123149 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.123232 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.123457 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.123539 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.123760 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.123853 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.124065 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.124155 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.124369 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.124468 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.124700 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.124797 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.125006 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.125097 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.125310 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.125394 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.125614 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.125699 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.125918 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.126002 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.126252 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.126339 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.126556 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.126648 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.126861 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.126951 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.127166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.127257 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.127477 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.127569 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.127780 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.127872 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.128091 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.128182 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.128399 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.128491 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.128720 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.128808 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.129029 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.129121 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.129335 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.129429 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.129649 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.129740 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.129960 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.130053 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.130305 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.130390 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.130615 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.130699 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.130923 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.131019 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.131232 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.131315 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.131559 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.131643 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.131876 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.132092 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.132177 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.132428 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.132512 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.132751 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.132841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.133087 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.133339 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.133424 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.133676 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.133760 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.133999 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.134091 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.134332 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.134415 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.134659 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.134743 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.134972 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.135060 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.135278 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.135407 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.135585 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.135669 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.135890 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.135974 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.136200 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.136293 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.136512 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.136609 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.136817 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.136901 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.137123 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.137206 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.137428 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.137551 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.137738 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.137822 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.138042 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.138217 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.138374 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.138468 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.138682 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.138771 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.138988 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.139079 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.139299 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.139392 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.139611 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.139704 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.139921 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.140033 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.140276 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.140363 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.140590 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.140681 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.140906 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.140990 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.141216 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.141301 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.141524 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.141608 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.141832 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.141925 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.142162 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.142251 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.142476 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.142559 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.142788 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.142884 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.143097 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.143182 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.143404 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.143494 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.143721 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.144050 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.144138 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.144363 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.144446 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.144666 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.144763 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.144987 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.145297 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.145384 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.145620 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.145705 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.145940 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.146024 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.146270 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.146356 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.146589 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.146672 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.146895 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.146981 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.147221 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.147304 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.147533 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.147627 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.147856 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.147952 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.148170 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.148297 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.148472 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.148564 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.148778 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.148863 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.149082 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.149165 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.149391 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.149483 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.149710 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.149830 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.150020 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.150149 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.150351 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.150439 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.150658 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.150750 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.150968 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.151691 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.151793 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.151882 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.151968 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152047 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152131 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152209 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152295 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152381 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152459 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152537 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152719 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.152804 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.153019 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.153105 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.153326 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.153410 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.153634 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.153727 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.153937 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.154028 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.154265 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.154351 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.154570 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.154667 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.154868 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.154952 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.155171 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.155261 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.155468 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.155573 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156293 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156389 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156469 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156546 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156546 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156697 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156776 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156863 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.156969 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.157054 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.157274 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.157360 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.157607 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.157691 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.157923 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.158014 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.158256 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.158391 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.158581 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.158666 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.158895 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.158977 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.159208 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.159305 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.159514 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.159596 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.159837 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.159928 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.160144 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.160228 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.160456 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.160542 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.160811 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.160911 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.161069 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.161154 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.161376 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.161462 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.161686 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.161787 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.161994 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.162085 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.162342 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.162428 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.162643 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.162744 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.162954 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.163037 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.163273 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.163356 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.163589 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.163675 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.163893 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.163987 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.164199 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.164288 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.164525 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.164617 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.164834 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.164918 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.165145 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.165230 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.165455 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.165547 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.165760 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.165843 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.166068 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.166201 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.166408 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.166492 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.166714 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.166797 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.167021 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.167112 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.167334 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.167418 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.167648 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.167731 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.167956 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.168047 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.168270 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.168354 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.168586 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.168676 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.168901 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.168993 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.169223 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.169306 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.169547 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.169675 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.169862 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.169948 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.170215 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.170303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.170545 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.170642 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.170855 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.170947 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.171165 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.171250 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.171518 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.171617 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.171760 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:21:26.171938 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.172254 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.172567 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.172874 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:21:26.173119 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:21:26.328101 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO dbcounter [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Registered counter for database nova_api Sep 13 15:21:26.328391 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO dbcounter [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Registered counter for database nova_api Sep 13 15:21:26.352502 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_db.sqlalchemy.engines [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.354389 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.360250 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writer thread running {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.361620 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writer thread running {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.417270 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.context [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6341116c-714b-4fb7-baa1-e332de6a8c49(cell1) {{(pid=105481) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 15:21:26.417811 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.context [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6341116c-714b-4fb7-baa1-e332de6a8c49(cell1) {{(pid=105482) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 15:21:26.421131 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:21:26.421613 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:21:26.421771 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_concurrency.lockutils [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:21:26.422218 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_concurrency.lockutils [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:21:26.423199 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:21:26.423782 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_concurrency.lockutils [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:21:26.423914 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:21:26.424324 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:21:26.424454 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_concurrency.lockutils [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:21:26.424914 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_concurrency.lockutils [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:21:26.426301 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:21:26.426946 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_concurrency.lockutils [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:21:26.428305 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO dbcounter [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Registered counter for database nova_cell0 Sep 13 15:21:26.428959 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO dbcounter [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Registered counter for database nova_cell0 Sep 13 15:21:26.432335 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO dbcounter [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Registered counter for database nova_cell1 Sep 13 15:21:26.432934 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO dbcounter [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Registered counter for database nova_cell1 Sep 13 15:21:26.439831 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_db.sqlalchemy.engines [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.441487 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_db.sqlalchemy.engines [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.444746 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.446727 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writer thread running {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.446970 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.450626 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writer thread running {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.456398 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writer thread running {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.581857 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writer thread running {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.592259 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO dbcounter [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Registered counter for database nova_cell0 Sep 13 15:21:26.594561 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO dbcounter [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Registered counter for database nova_cell0 Sep 13 15:21:26.601090 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_db.sqlalchemy.engines [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.605304 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:21:26.607154 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writer thread running {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.610569 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writer thread running {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:21:26.943406 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: WARNING keystonemiddleware.auth_token [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:21:26.946220 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: WARNING keystonemiddleware.auth_token [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:21:26.950701 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: WARNING keystonemiddleware.auth_token [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:21:26.953768 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: WARNING keystonemiddleware.auth_token [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:21:27.292917 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: WARNING keystonemiddleware.auth_token [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:21:27.296768 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: WARNING keystonemiddleware.auth_token [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:21:27.298852 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: WARNING keystonemiddleware.auth_token [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:21:27.302779 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: WARNING keystonemiddleware.auth_token [None req-ec6ce282-a23c-46a9-a84e-c13a611a2ed1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:21:27.304116 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fe061a9c0 pid: 105481 (default app) Sep 13 15:21:27.306171 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:21:27.307352 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Sep 13 15:21:27.307753 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Tue Sep 13 15:21:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:21:27.308082 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fe061a9c0 pid: 105482 (default app) Sep 13 15:22:49.723199 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:22:49.725034 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002319 Sep 13 15:22:49.725794 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:22:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:22:49.738159 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_api:SELECT=3 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:49.739307 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_cell0:SELECT=3 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:49.740173 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_cell1:SELECT=3 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:49.742274 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:50.632736 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-2e963d68-fe07-4786-8c78-e54b8bd27636 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:22:50.666690 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-2e963d68-fe07-4786-8c78-e54b8bd27636 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933926 Sep 13 15:22:50.667507 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 13 15:22:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:22:53.255004 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:22:53.256038 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-e4309bf1-0208-4d48-a981-0aec193187f7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Sep 13 15:22:53.256468 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:22:53.718092 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-afe51c10-6c00-4602-a46e-d5153da0aea7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "disk": 1, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:22:53.768299 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-afe51c10-6c00-4602-a46e-d5153da0aea7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505444 Sep 13 15:22:53.768879 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:22:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:22:53.782676 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_api:SELECT=3 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:53.783459 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_cell0:SELECT=3 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:53.785416 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_cell1:SELECT=3 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:53.786495 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:22:53.992602 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-5e7a9ce6-c95a-4907-8421-f737daf18662 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:22:54.063494 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-5e7a9ce6-c95a-4907-8421-f737daf18662 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286019 Sep 13 15:22:54.064093 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 13 15:22:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:22:56.719764 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-afe51c10-6c00-4602-a46e-d5153da0aea7 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:22:56.720793 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-afe51c10-6c00-4602-a46e-d5153da0aea7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 13 15:22:56.721179 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:22:57.391103 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-470286ab-2d1a-4004-8f83-ff647ee560cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "swap": 0}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:22:57.430407 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-470286ab-2d1a-4004-8f83-ff647ee560cd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702029 Sep 13 15:22:57.431341 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:22:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:22:57.443267 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-6661c35d-48f4-4fb3-bb64-bb3a7496cf89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:22:57.486620 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-6661c35d-48f4-4fb3-bb64-bb3a7496cf89 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046931 Sep 13 15:22:57.487639 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 13 15:22:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:23:00.074425 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-470286ab-2d1a-4004-8f83-ff647ee560cd admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:00.075527 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-470286ab-2d1a-4004-8f83-ff647ee560cd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Sep 13 15:23:00.075952 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:00.494401 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-a1637bcd-f98f-42be-9ecd-faa5fa2c4fd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2"}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:00.514869 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-a1637bcd-f98f-42be-9ecd-faa5fa2c4fd7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432132 Sep 13 15:23:00.515421 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:00.527835 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-200f3732-aed2-42a4-a9ea-55c67b473d25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:00.562139 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-200f3732-aed2-42a4-a9ea-55c67b473d25 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037862 Sep 13 15:23:00.562731 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 13 15:23:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:23:03.196935 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-a1637bcd-f98f-42be-9ecd-faa5fa2c4fd7 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:03.197891 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-a1637bcd-f98f-42be-9ecd-faa5fa2c4fd7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 13 15:23:03.198479 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:03.629184 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-e2a7f161-3220-4770-a5e7-2d748ecc7d7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:03.655451 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-e2a7f161-3220-4770-a5e7-2d748ecc7d7b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450597 Sep 13 15:23:03.656312 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:03.670166 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-44ea2f1c-8d49-4933-9e94-1e0a8be65941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:03.703008 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-44ea2f1c-8d49-4933-9e94-1e0a8be65941 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037862 Sep 13 15:23:03.704273 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 13 15:23:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:23:06.347048 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-e2a7f161-3220-4770-a5e7-2d748ecc7d7b admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:06.348487 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-e2a7f161-3220-4770-a5e7-2d748ecc7d7b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002871 Sep 13 15:23:06.349264 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:06.906644 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-e3df7607-9e9e-4e41-9331-76c5159b494d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:06.930142 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-e3df7607-9e9e-4e41-9331-76c5159b494d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.572898 Sep 13 15:23:06.930893 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:06.946090 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-4dc457b0-37e6-4f51-a023-775200c8b943 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:06.977160 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-4dc457b0-37e6-4f51-a023-775200c8b943 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036318 Sep 13 15:23:06.977860 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Sep 13 15:23:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:23:09.635287 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-e3df7607-9e9e-4e41-9331-76c5159b494d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:09.636440 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-e3df7607-9e9e-4e41-9331-76c5159b494d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001769 Sep 13 15:23:09.636930 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:10.087776 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-7ec0da1d-ca33-4d59-a673-ec1f4455d79f admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:10.113470 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-7ec0da1d-ca33-4d59-a673-ec1f4455d79f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469937 Sep 13 15:23:10.113896 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 13 15:23:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:12.898365 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-e3df7607-9e9e-4e41-9331-76c5159b494d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:12.899439 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-e3df7607-9e9e-4e41-9331-76c5159b494d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Sep 13 15:23:12.899846 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:23:13.310712 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-448217e1-ad65-4f8b-b901-253a68d6de82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:13.333646 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-448217e1-ad65-4f8b-b901-253a68d6de82 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.427401 Sep 13 15:23:13.334192 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:13.348037 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-adcac7a2-8ad5-4adc-9a41-12d17afdd50e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:13.384342 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-adcac7a2-8ad5-4adc-9a41-12d17afdd50e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041259 Sep 13 15:23:13.384957 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 13 15:23:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:23:16.000207 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-448217e1-ad65-4f8b-b901-253a68d6de82 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:16.001662 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-448217e1-ad65-4f8b-b901-253a68d6de82 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Sep 13 15:23:16.002068 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:16.367272 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-53789cbf-686d-4168-8b27-8b739a60c418 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:16.388345 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-53789cbf-686d-4168-8b27-8b739a60c418 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.378572 Sep 13 15:23:16.388944 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 15:23:16.401595 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-6b613293-887a-4565-9857-e404dec5b3d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:16.428032 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-6b613293-887a-4565-9857-e404dec5b3d9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030588 Sep 13 15:23:16.428721 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 13 15:23:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:23:19.046524 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-53789cbf-686d-4168-8b27-8b739a60c418 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:19.048384 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-53789cbf-686d-4168-8b27-8b739a60c418 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002337 Sep 13 15:23:19.050415 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:19.499806 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-f1fe30fd-5cd6-481e-8ece-aa8660ccb564 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "name": "m1.medium"}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:19.532755 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-f1fe30fd-5cd6-481e-8ece-aa8660ccb564 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.477614 Sep 13 15:23:19.543357 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:19.548331 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-e95eb521-00b9-4d4e-95ec-5cd2070c5912 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:19.581157 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-e95eb521-00b9-4d4e-95ec-5cd2070c5912 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039086 Sep 13 15:23:19.581751 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 13 15:23:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:23:22.192133 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-f1fe30fd-5cd6-481e-8ece-aa8660ccb564 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:22.193069 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-f1fe30fd-5cd6-481e-8ece-aa8660ccb564 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 13 15:23:22.204156 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:22.784704 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-a5ddce72-edf4-494b-ac89-59b8efeab7be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:22.791097 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:22.810285 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-a5ddce72-edf4-494b-ac89-59b8efeab7be admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.609941 Sep 13 15:23:22.810941 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:22.823465 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-bac47477-2361-449e-9d5c-a2ac729d0aa4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:22.851190 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-bac47477-2361-449e-9d5c-a2ac729d0aa4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031709 Sep 13 15:23:22.866205 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 13 15:23:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:23:25.433380 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-a5ddce72-edf4-494b-ac89-59b8efeab7be admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:25.435117 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-a5ddce72-edf4-494b-ac89-59b8efeab7be admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002196 Sep 13 15:23:25.435663 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:25.877151 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-0dd60f45-0a6e-44cc-9fb8-d6fb7466ddfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:25.885851 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:25.903148 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-0dd60f45-0a6e-44cc-9fb8-d6fb7466ddfc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461425 Sep 13 15:23:25.904030 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Sep 13 15:23:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 15:23:25.916514 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-e8ecf1f1-c24e-4a88-8667-7006133b5233 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:25.946127 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-e8ecf1f1-c24e-4a88-8667-7006133b5233 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033699 Sep 13 15:23:25.952519 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Sep 13 15:23:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:23:42.375159 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-0dd60f45-0a6e-44cc-9fb8-d6fb7466ddfc admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:42.376585 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-0dd60f45-0a6e-44cc-9fb8-d6fb7466ddfc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002360 Sep 13 15:23:42.377246 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:42.391687 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:23:42.830756 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-060b0357-3d8d-4832-aaf0-026cac9c0b02 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:42.849663 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-060b0357-3d8d-4832-aaf0-026cac9c0b02 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.465405 Sep 13 15:23:42.850217 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 13 15:23:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:44.214140 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-0dd60f45-0a6e-44cc-9fb8-d6fb7466ddfc admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:44.215181 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-0dd60f45-0a6e-44cc-9fb8-d6fb7466ddfc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 13 15:23:44.215575 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:44.792915 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-1283036a-c3bc-4f35-97ef-8cd53ebedcbc admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:44.798434 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.wsgi [None req-1283036a-c3bc-4f35-97ef-8cd53ebedcbc admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-1283036a-c3bc-4f35-97ef-8cd53ebedcbc admin admin] Request method failure captured: Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Accept: application/json Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Accept-Encoding: gzip, deflate Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Connection: keep-alive Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Content-Length: 0 Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Host: 10.222.0.16 Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Openstack-Api-Version: compute 2.92 Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Openstack-System-Scope: None Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: User-Agent: python-novaclient Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Auth-Token: gAAAAABjIKCA9UkOOwuvhC874ehxwDU_NgM-Nlp6D9cmDN_VzLjsR_xLvmdK0WCrPmR_rHQxCxuO-k4yVRaMdsaqBwpYNxQm9bmHsPskhTRY2mropLxAnWUoRHEMk9hIrsJU2PrzsbOOxOWiHFgcEMH_ZSHh8dfB0ADApi21iOzl_YgEeQ_xjnQ Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Domain-Id: None Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Domain-Name: None Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Identity-Status: Confirmed Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Is-Admin-Project: True Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Domain-Id: default Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Domain-Name: Default Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Name: admin Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Role: reader,admin,member Sep 13 15:23:44.801703 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Roles: reader,admin,member Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}] Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant: admin Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant-Name: admin Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User: admin Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Domain-Id: default Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Domain-Name: Default Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Id: d29c3b9b96c24a7daf5c64be528badeb Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Name: admin Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: method: > Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: exception: Flavor 42 could not be found. Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: action_args: {'id': '42'} Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:23:44.803248 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:44.804340 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.805890 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-1283036a-c3bc-4f35-97ef-8cd53ebedcbc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:23:44.807267 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-1283036a-c3bc-4f35-97ef-8cd53ebedcbc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.452595 Sep 13 15:23:44.807267 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 13 15:23:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:44.814232 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-8a623239-9309-4030-aea7-71fdf9bec4d3 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:44.836822 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-8a623239-9309-4030-aea7-71fdf9bec4d3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027063 Sep 13 15:23:44.837388 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 13 15:23:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:44.848913 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-86049cba-43bb-4ad8-b9a0-e61c1feb43e6 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:44.872147 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-86049cba-43bb-4ad8-b9a0-e61c1feb43e6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028242 Sep 13 15:23:44.872751 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 13 15:23:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:44.882669 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-f945b2a6-4ce0-4f52-a14c-1613a6ccb634 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:44.888307 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.wsgi [None req-f945b2a6-4ce0-4f52-a14c-1613a6ccb634 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-f945b2a6-4ce0-4f52-a14c-1613a6ccb634 admin admin] Request method failure captured: Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Accept: application/json Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Accept-Encoding: gzip, deflate Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Connection: keep-alive Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Content-Length: 0 Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Host: 10.222.0.16 Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Openstack-Api-Version: compute 2.92 Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Openstack-System-Scope: None Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: User-Agent: python-novaclient Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Auth-Token: gAAAAABjIKCA9UkOOwuvhC874ehxwDU_NgM-Nlp6D9cmDN_VzLjsR_xLvmdK0WCrPmR_rHQxCxuO-k4yVRaMdsaqBwpYNxQm9bmHsPskhTRY2mropLxAnWUoRHEMk9hIrsJU2PrzsbOOxOWiHFgcEMH_ZSHh8dfB0ADApi21iOzl_YgEeQ_xjnQ Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Domain-Id: None Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Domain-Name: None Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Identity-Status: Confirmed Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Is-Admin-Project: True Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Domain-Id: default Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Domain-Name: Default Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Name: admin Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Role: reader,admin,member Sep 13 15:23:44.891607 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Roles: reader,admin,member Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}] Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant: admin Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant-Name: admin Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User: admin Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Domain-Id: default Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Domain-Name: Default Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Id: d29c3b9b96c24a7daf5c64be528badeb Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Name: admin Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: method: > Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: exception: Flavor 42 could not be found. Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: action_args: {'id': '42'} Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:23:44.893137 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:44.894013 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:44.895166 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-f945b2a6-4ce0-4f52-a14c-1613a6ccb634 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:23:44.896170 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-f945b2a6-4ce0-4f52-a14c-1613a6ccb634 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014011 Sep 13 15:23:44.896170 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 13 15:23:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:46.152745 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-86049cba-43bb-4ad8-b9a0-e61c1feb43e6 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:46.153770 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-86049cba-43bb-4ad8-b9a0-e61c1feb43e6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 13 15:23:46.154217 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:46.718052 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-0aa35288-137b-494a-9642-91b9d3a03f1d admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:46.723805 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.wsgi [None req-0aa35288-137b-494a-9642-91b9d3a03f1d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-0aa35288-137b-494a-9642-91b9d3a03f1d admin admin] Request method failure captured: Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Accept: application/json Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Accept-Encoding: gzip, deflate Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Connection: keep-alive Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Content-Length: 0 Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Host: 10.222.0.16 Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Openstack-Api-Version: compute 2.92 Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Openstack-System-Scope: None Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: User-Agent: python-novaclient Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Auth-Token: gAAAAABjIKCC5Ju8Fjkvpl7Nl5-s6ckahZ9P0G8TmHEnQP14HpmWtWuQsvrn2zbVY_yblkp0sjpq5wCc-OijTgSgQWcJYPyr7C6EQKv3y6itVp08FYUIc7sKwa8__zgQ8sVaVa1swhVgtvPUqBtnYkeOtK-JKjZFS0NqODOCPgLykFcOwwOfpMY Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Domain-Id: None Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Domain-Name: None Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Identity-Status: Confirmed Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Is-Admin-Project: True Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Domain-Id: default Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Domain-Name: Default Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Name: admin Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Role: reader,admin,member Sep 13 15:23:46.725322 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Roles: reader,admin,member Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}] Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant: admin Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant-Name: admin Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User: admin Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Domain-Id: default Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Domain-Name: Default Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Id: d29c3b9b96c24a7daf5c64be528badeb Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Name: admin Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: method: > Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: exception: Flavor 84 could not be found. Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: action_args: {'id': '84'} Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:23:46.726715 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:46.728303 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.729593 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-0aa35288-137b-494a-9642-91b9d3a03f1d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:23:46.730749 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-0aa35288-137b-494a-9642-91b9d3a03f1d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.436967 Sep 13 15:23:46.730749 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 13 15:23:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:46.739790 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-8227ad9b-2107-417c-8506-ce3790afc6f0 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:46.756284 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-8227ad9b-2107-417c-8506-ce3790afc6f0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022570 Sep 13 15:23:46.757026 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 13 15:23:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:46.766467 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-730a92b7-647b-4e45-9fcb-41bb8a269b5b admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:46.783040 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-730a92b7-647b-4e45-9fcb-41bb8a269b5b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020155 Sep 13 15:23:46.783568 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 13 15:23:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:46.793002 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-dc2f5133-2d2d-419b-8d14-2bc650a7a860 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:46.798464 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.wsgi [None req-dc2f5133-2d2d-419b-8d14-2bc650a7a860 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-dc2f5133-2d2d-419b-8d14-2bc650a7a860 admin admin] Request method failure captured: Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Accept: application/json Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Accept-Encoding: gzip, deflate Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Connection: keep-alive Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Content-Length: 0 Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Host: 10.222.0.16 Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Openstack-Api-Version: compute 2.92 Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Openstack-System-Scope: None Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: User-Agent: python-novaclient Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Auth-Token: gAAAAABjIKCC5Ju8Fjkvpl7Nl5-s6ckahZ9P0G8TmHEnQP14HpmWtWuQsvrn2zbVY_yblkp0sjpq5wCc-OijTgSgQWcJYPyr7C6EQKv3y6itVp08FYUIc7sKwa8__zgQ8sVaVa1swhVgtvPUqBtnYkeOtK-JKjZFS0NqODOCPgLykFcOwwOfpMY Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Domain-Id: None Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Domain-Name: None Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Identity-Status: Confirmed Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Is-Admin-Project: True Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Domain-Id: default Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Domain-Name: Default Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Name: admin Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Role: reader,admin,member Sep 13 15:23:46.799993 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Roles: reader,admin,member Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}] Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant: admin Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant-Name: admin Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User: admin Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Domain-Id: default Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Domain-Name: Default Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Id: d29c3b9b96c24a7daf5c64be528badeb Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Name: admin Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: method: > Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: exception: Flavor 84 could not be found. Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: action_args: {'id': '84'} Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:23:46.801529 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:46.803972 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:46.805085 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-dc2f5133-2d2d-419b-8d14-2bc650a7a860 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:23:46.806415 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-dc2f5133-2d2d-419b-8d14-2bc650a7a860 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011927 Sep 13 15:23:46.806415 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Sep 13 15:23:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:48.030640 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-730a92b7-647b-4e45-9fcb-41bb8a269b5b admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:48.031652 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-730a92b7-647b-4e45-9fcb-41bb8a269b5b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 13 15:23:48.032050 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:48.602443 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-c116cf7d-2855-4549-a40a-cf89f9894ca1 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:48.608536 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.wsgi [None req-c116cf7d-2855-4549-a40a-cf89f9894ca1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-c116cf7d-2855-4549-a40a-cf89f9894ca1 admin admin] Request method failure captured: Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Accept: application/json Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Accept-Encoding: gzip, deflate Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Connection: keep-alive Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Content-Length: 0 Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Host: 10.222.0.16 Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Openstack-Api-Version: compute 2.92 Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Openstack-System-Scope: None Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: User-Agent: python-novaclient Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Auth-Token: gAAAAABjIKCD8KRgPaNinEBv-VyNYc-7heJ2TDoC1rP6I1LK6UmhHiN0afWntzCpwcT99Ghl3xm-Y2S8BAyy2Pd4E5qILnC4BLXwUzL_FuEeUURZ_6izFFoaFL-LoT2KQL8Z_9xTA6Qt02BJSe6SIGQajnHsPY19ti9vto27XumHpwWqKstsal8 Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Domain-Id: None Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Domain-Name: None Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Identity-Status: Confirmed Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Is-Admin-Project: True Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Domain-Id: default Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Domain-Name: Default Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Project-Name: admin Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Role: reader,admin,member Sep 13 15:23:48.610022 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Roles: reader,admin,member Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}] Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant: admin Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-Tenant-Name: admin Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User: admin Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Domain-Id: default Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Domain-Name: Default Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Id: d29c3b9b96c24a7daf5c64be528badeb Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: X-User-Name: admin Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: method: > Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: exception: Flavor 451 could not be found. Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: action_args: {'id': '451'} Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:23:48.611627 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:48.612576 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.613841 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-c116cf7d-2855-4549-a40a-cf89f9894ca1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:23:48.615073 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-c116cf7d-2855-4549-a40a-cf89f9894ca1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.442203 Sep 13 15:23:48.615073 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 13 15:23:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:48.622349 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-002af78d-d8c6-4c96-8dc2-0e514b4923fd admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:48.638213 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-002af78d-d8c6-4c96-8dc2-0e514b4923fd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019328 Sep 13 15:23:48.638686 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 13 15:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:48.648597 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:48.664091 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019210 Sep 13 15:23:48.664628 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Sep 13 15:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:23:48.674851 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-c8ce8605-646d-41d4-a9d6-e1d8fb377f5e admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:48.679968 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.wsgi [None req-c8ce8605-646d-41d4-a9d6-e1d8fb377f5e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-c8ce8605-646d-41d4-a9d6-e1d8fb377f5e admin admin] Request method failure captured: Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Accept: application/json Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Accept-Encoding: gzip, deflate Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Connection: keep-alive Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Content-Length: 0 Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Host: 10.222.0.16 Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Openstack-Api-Version: compute 2.92 Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Openstack-System-Scope: None Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: User-Agent: python-novaclient Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Auth-Token: gAAAAABjIKCD8KRgPaNinEBv-VyNYc-7heJ2TDoC1rP6I1LK6UmhHiN0afWntzCpwcT99Ghl3xm-Y2S8BAyy2Pd4E5qILnC4BLXwUzL_FuEeUURZ_6izFFoaFL-LoT2KQL8Z_9xTA6Qt02BJSe6SIGQajnHsPY19ti9vto27XumHpwWqKstsal8 Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Domain-Id: None Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Domain-Name: None Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Identity-Status: Confirmed Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Is-Admin-Project: True Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Domain-Id: default Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Domain-Name: Default Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Project-Name: admin Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Role: reader,admin,member Sep 13 15:23:48.681507 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Roles: reader,admin,member Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3dcdfc529b6149688ceee6b949a735a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3dcdfc529b6149688ceee6b949a735a1"}]}] Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant: admin Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant-Id: 3dcdfc529b6149688ceee6b949a735a1 Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-Tenant-Name: admin Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User: admin Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Domain-Id: default Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Domain-Name: Default Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Id: d29c3b9b96c24a7daf5c64be528badeb Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: X-User-Name: admin Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: method: > Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: exception: Flavor 451 could not be found. Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: action_args: {'id': '451'} Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:23:48.683142 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:48.684317 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: ERROR nova.api.openstack.wsgi Sep 13 15:23:48.685681 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-c8ce8605-646d-41d4-a9d6-e1d8fb377f5e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:23:48.686960 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-c8ce8605-646d-41d4-a9d6-e1d8fb377f5e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011786 Sep 13 15:23:48.686960 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 13 15:23:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 15:23:49.920875 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:49.922198 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Sep 13 15:23:49.922734 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:50.472101 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-418631cd-3a33-4fea-8ce8-0879c2b891b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:50.496017 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-418631cd-3a33-4fea-8ce8-0879c2b891b8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.435565 Sep 13 15:23:50.496595 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 13 15:23:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 15:23:51.741346 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:51.742424 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 13 15:23:51.742849 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:52.302279 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-de2bf8ef-df5e-4f14-92e1-ba1153334306 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:52.328962 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-de2bf8ef-df5e-4f14-92e1-ba1153334306 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.449700 Sep 13 15:23:52.329498 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 13 15:23:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:53.595255 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:53.596587 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Sep 13 15:23:53.597158 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:54.136536 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-1b23f032-e7e7-48a4-b608-00ea489cdaf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:54.162911 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-1b23f032-e7e7-48a4-b608-00ea489cdaf0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.430018 Sep 13 15:23:54.163537 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 13 15:23:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:55.413445 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:55.414485 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 13 15:23:55.415028 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:55.991651 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-d7038d42-3634-4ed7-bfeb-8693f2c7a30e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:23:56.014183 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-d7038d42-3634-4ed7-bfeb-8693f2c7a30e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.455618 Sep 13 15:23:56.014735 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Sep 13 15:23:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:23:57.259735 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:57.260780 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 13 15:23:57.261183 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:23:57.819271 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-54430d22-19b8-4546-8710-5139b04db89f admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:23:57.840502 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-54430d22-19b8-4546-8710-5139b04db89f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.437325 Sep 13 15:23:57.841045 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Tue Sep 13 15:23:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:24:55.373263 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:24:55.374969 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-f5980021-6844-4d5f-9bf8-1e1df02be24d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002439 Sep 13 15:24:55.375577 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Tue Sep 13 15:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:24:55.390063 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:24:55.793405 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-95f393b0-b384-41c6-be3b-292c4546aca0 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:24:55.814042 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-95f393b0-b384-41c6-be3b-292c4546aca0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428563 Sep 13 15:24:55.814648 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Sep 13 15:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:24:55.835506 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_api:SELECT=14 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:24:55.839474 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-e3c77f01-f0b2-4ea7-8b6b-0c3862c5eddf admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:24:55.847238 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-e3c77f01-f0b2-4ea7-8b6b-0c3862c5eddf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013147 Sep 13 15:24:55.847766 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Tue Sep 13 15:24:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:24:55.867245 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-c922d54d-4a9b-4798-ab9f-8c3c6e10ea38 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:24:55.875623 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-c922d54d-4a9b-4798-ab9f-8c3c6e10ea38 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014424 Sep 13 15:24:55.876138 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Tue Sep 13 15:24:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:24:55.887598 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:24:55.894827 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010936 Sep 13 15:24:55.895339 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Tue Sep 13 15:24:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:24:55.909867 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-4b4ee472-8ad0-4e1f-9bf0-766cd8d94371 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:24:55.921673 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-4b4ee472-8ad0-4e1f-9bf0-766cd8d94371 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017582 Sep 13 15:24:55.922579 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Tue Sep 13 15:24:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:27:55.396092 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:27:55.397103 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 13 15:27:55.397520 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:27:55.540705 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_api:SELECT=6 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:27:55.711637 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:27:55.719210 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:27:55.719861 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:27:55.720365 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:27:55.721365 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:27:55.721905 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:27:55.722515 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:27:55.758362 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-62417117-3a98-4a10-b044-d99d4eb78340 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.218974 Sep 13 15:27:55.758928 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 13 15:27:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:27:56.834132 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:27:56.835153 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 13 15:27:56.835557 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:27:57.029548 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:27:57.032995 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:27:57.033470 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:27:57.033889 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:27:57.034645 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:27:57.035082 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:27:57.035494 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:27:57.054903 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-21f5482d-1f24-490d-b2f7-a8fecee808db admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081298 Sep 13 15:27:57.055454 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 13 15:27:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:28:08.537679 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:28:08.539040 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Sep 13 15:28:08.539530 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:28:08.687444 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_cell0:SELECT=4 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:08.688341 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_cell1:SELECT=4 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:08.688989 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG dbcounter [-] [105481] Writing DB stats nova_api:SELECT=8 {{(pid=105481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:28:08.739225 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:28:08.742631 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:28:08.743100 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:28:08.743520 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:28:08.744251 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:28:08.744686 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:28:08.745089 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:28:08.769976 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-ca9624ed-d05b-440e-af47-18358d81871f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.090030 Sep 13 15:28:08.770565 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 13 15:28:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:28:09.868632 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG nova.api.openstack.wsgi [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] Calling method '>' {{(pid=105482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:28:09.869617 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: INFO nova.api.openstack.requestlog [None req-134b951a-1fb3-402b-b16f-38a7dc47c082 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 13 15:28:09.870012 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: [pid: 105482|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Sep 13 15:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:28:10.066281 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG nova.api.openstack.wsgi [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] Calling method '>' {{(pid=105481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:28:10.069864 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:28:10.070370 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:28:10.070792 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:28:10.071499 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:28:10.071941 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:28:10.072348 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: DEBUG oslo_concurrency.lockutils [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:28:10.093795 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: INFO nova.api.openstack.requestlog [None req-0d3028d2-2760-499e-ba82-86571b2de705 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.081266 Sep 13 15:28:10.094396 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: [pid: 105481|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Sep 13 15:28:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:29:08.354730 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: Tue Sep 13 15:29:08 2022 - graceful shutdown triggered... Sep 13 15:29:08.354870 dv-cinder-857434-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 15:29:08.355896 dv-cinder-857434-2-iscsi devstack@n-api.service[105481]: Gracefully killing worker 1 (pid: 105481)... Sep 13 15:29:08.356346 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: Gracefully killing worker 2 (pid: 105482)... Sep 13 15:29:08.488381 dv-cinder-857434-2-iscsi devstack@n-api.service[105482]: DEBUG dbcounter [-] [105482] Writing DB stats nova_api:SELECT=4 {{(pid=105482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:09.357257 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: worker 1 buried after 1 seconds Sep 13 15:29:09.357257 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: worker 2 buried after 1 seconds Sep 13 15:29:09.357257 dv-cinder-857434-2-iscsi devstack@n-api.service[105480]: goodbye to uWSGI. Sep 13 15:29:09.359788 dv-cinder-857434-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 15:29:09.360698 dv-cinder-857434-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 15:29:09.365093 dv-cinder-857434-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 15:29:09.381450 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 15:29:09.386269 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 15:29:09 2022] *** Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: nodename: dv-cinder-857434-2-iscsi Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: machine: x86_64 Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: clock source: unix Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: pcre jit disabled Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: detected number of CPU cores: 4 Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: current working directory: / Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: detected binary path: /usr/bin/uwsgi-core Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: your processes number limit is 47680 Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: your memory page size is 4096 bytes Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: detected max file descriptor number: 2048 Sep 13 15:29:09.386608 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: lock engine: pthread robust mutexes Sep 13 15:29:09.388634 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: thunder lock: enabled Sep 13 15:29:09.388634 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 15:29:09.388634 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 15:29:09.429687 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: Python main interpreter initialized at 0x5607516a19c0 Sep 13 15:29:09.429687 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: python threads support enabled Sep 13 15:29:09.429687 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: your server socket listen backlog is limited to 100 connections Sep 13 15:29:09.429687 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: your mercy for graceful operations on workers is 90 seconds Sep 13 15:29:09.430183 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 15:29:09.430183 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: *** Operational MODE: preforking *** Sep 13 15:29:09.430466 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: *** uWSGI is running in multiple interpreter mode *** Sep 13 15:29:09.430466 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: spawned uWSGI master process (pid: 120641) Sep 13 15:29:09.430686 dv-cinder-857434-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 15:29:09.431403 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: spawned uWSGI worker 1 (pid: 120658, cores: 1) Sep 13 15:29:09.432397 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: spawned uWSGI worker 2 (pid: 120659, cores: 1) Sep 13 15:29:09.432397 dv-cinder-857434-2-iscsi devstack@n-api.service[120641]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 15:29:10.085693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 15:29:10.090227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 15:29:11.253235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:29:11.253235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: from cryptography.utils import int_from_bytes Sep 13 15:29:11.253881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:29:11.253881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: from cryptography.utils import int_from_bytes Sep 13 15:29:11.260802 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:29:11.260802 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: from cryptography.utils import int_from_bytes Sep 13 15:29:11.261336 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 15:29:11.261336 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: from cryptography.utils import int_from_bytes Sep 13 15:29:13.629988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:29:13.630930 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:29:13.631643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:29:13.632177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:29:13.632583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:29:13.633138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.633613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.634090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.634591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.635079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.635565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.636040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.636510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.636990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.637411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.638727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.638821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-2-iscsi {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.639203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.639473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.644738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.645315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.645315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.645559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-2-iscsi {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.646041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.646540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.647013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.647587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.648060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.648517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.648994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.649479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.649953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.650452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.650918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.651407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.651890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.652356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.653519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.654033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.654546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.655024 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.655489 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.655901 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.656357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.656837 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.657314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.657798 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.658233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.658644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.659118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.659585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.660058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.660507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.660965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.661415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.661873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.662386 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.662860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.663321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.663803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.664273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.664741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.665201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.665680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.666262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.666656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.667124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.667611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.668081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.668551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.669132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.669605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.670197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.670653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.671120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.671604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.672094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.672559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.672959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.673409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.673866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.674367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.674817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.675284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.675747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.676192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.676654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.677103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.677551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.678010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.678537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.679002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.679463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.679926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.680386 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.680854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.681334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.681810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.682312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.682779 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.683230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.683698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.684172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.684804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.685311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.685791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.686281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.686820 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.687297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.687756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.688206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.688665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.689110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.689442 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 15:29:13.689891 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 15:29:13.690185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.690295 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 15:29:13.690620 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 15:29:13.690835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.690924 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 15:29:13.691071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.691242 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.691566 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.691723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.691886 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.692194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.692306 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.692518 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.692622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.692824 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.692920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.693138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.693232 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.693451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.693547 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.693764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.693868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.694016 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.694180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.694411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.694735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.694852 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.695049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.695266 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-2-iscsi {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.695362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.695595 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.695698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.695905 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.696015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.696217 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.696324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.696545 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.696665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.696851 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.696948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.697173 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.697283 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.697490 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.697612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.697889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.698004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.698293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.698462 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.698620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.698824 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.698972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.699121 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.699277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.699443 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.699596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.699737 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.699886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.700034 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.700274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.700427 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.700604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.700761 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.701229 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.701400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.701558 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.701719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.701889 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-2-iscsi {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.702038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.702234 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.702392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.702552 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.702712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.702860 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.703007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.703153 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.703301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.703464 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.703621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.703775 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.703953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.704278 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.704441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.704602 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.704963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.705118 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.705273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.705428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.705583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.705746 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.705895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.706042 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.706280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.706431 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.706599 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.706749 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.706904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.707062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.707218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.707382 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.707544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.707700 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.707859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.708094 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.708255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.708517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.708693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.708850 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.709010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.709159 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.709312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.709468 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.709633 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.709792 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.709941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.710847 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.710847 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.711576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.711729 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.711872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.712014 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.712155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.712295 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.712451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.712690 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.712836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.712979 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.713119 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.713272 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.713425 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.713567 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.713707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.713848 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.713996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.714190 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.714438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.714600 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.714741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.714900 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.715149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.715327 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.715559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.715821 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.716690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.716856 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.717008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.717169 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.717319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.717468 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.717610 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.717610 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.717896 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.717896 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.718345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.718522 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.718781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.718781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.719078 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.719229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.719378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.719378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.719656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.719797 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.719946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.719946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.720233 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.720376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.720537 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.720686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.720837 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.720994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.721160 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.721668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.721825 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.721982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.722156 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.722313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.722456 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.722456 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.722732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.722900 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.723042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.723188 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.723329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.723476 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.723617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.723852 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.724009 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.724158 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.724306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.724464 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.725047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.725325 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.725498 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.725770 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.725917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.726059 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.726222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.726415 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.726578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.726729 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.726871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.727019 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.727174 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.727323 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.727478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.727638 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.727787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.727935 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.728083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.728233 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.728469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.728617 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.728775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.728998 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.729155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.729310 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.729460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.729602 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.729765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.729908 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.730058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.730259 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.730410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.730550 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.730705 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.730932 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.731099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.731249 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.731446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.731879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.732055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.732205 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.732360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.732518 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.732673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.732831 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.732989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.733137 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.733437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.733585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.733745 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.733899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.734059 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.734230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.734389 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.734537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.735821 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.736080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.736253 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.736416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.736623 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.736623 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.736927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.737085 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.737233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.737403 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.737551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.737705 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.737871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.738027 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.738212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.738362 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.738613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.738779 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.738779 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.739163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.739317 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.739481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.739640 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.739801 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.739955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.740120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.740270 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.740417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.740563 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.740723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.740879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 15:29:13.741035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.741189 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.741338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.741485 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.741926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.742118 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.742276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.742424 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.742581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.742740 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.742890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.743045 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.743193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.743301 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.743458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.743620 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.743781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.743928 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.744075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.744257 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.744417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.744580 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.744738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.744895 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.745044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.745199 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.745362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.745512 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.745666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.745998 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.746292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.746449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.746694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.746856 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.747042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.747257 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.747407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.747555 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.747716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.747864 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.748018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.748174 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.748340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.748495 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.748740 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.748894 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.749041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.749215 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.749446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.749600 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.749764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.749927 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.750083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.750083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.750471 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.750636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.750796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.750796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.751228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.751383 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.751383 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.751683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.751683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.752837 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.752987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.753135 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.753291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.753466 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.753622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.753777 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.753928 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.754074 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.754245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.754486 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.754645 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.754793 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.754793 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.755082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.755239 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.755387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.755387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.755690 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.755837 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.756168 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.756436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.756593 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.756793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.756953 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.757110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.757268 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.757430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.757578 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.757737 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.757903 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.758053 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.758223 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.758389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.758545 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.758720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.758907 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.759060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.759218 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.759367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.759598 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.759760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.759928 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.760085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.760248 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.760397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.760544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.760690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.760837 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.760984 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.761225 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.761388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.761538 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.761693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.761842 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.761842 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.762414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.762593 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.762851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.763014 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.763163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.763321 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.763470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.763617 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.763772 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.763920 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.764069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.764225 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.764402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.764551 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.764697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.764851 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.765006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.765168 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.765315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.765470 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.765618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.765772 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.765927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.766255 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.766434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.766695 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.766896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.767057 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.767219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.767376 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.767526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.767683 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.767838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.768125 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.768311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.768462 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.768611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.768768 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.768916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.769071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.769071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.769375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.769530 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.770276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.770436 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.770585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.770748 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.770898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.771045 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.771045 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.771597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.771764 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.771923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.773037 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.773216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.773379 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.773537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.773693 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.773882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.774049 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.774255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.774418 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.774578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.774578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.774875 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.775023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.775177 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.775334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.775491 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.775640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.775795 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.775946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.776103 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.776269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.776582 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.776840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.777048 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.777198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.777355 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.777512 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.777670 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.777827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.777984 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.778151 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.778437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.778594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.778753 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.778901 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.779063 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.779219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.779383 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.779532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.779685 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.779924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.780088 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.780250 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.780420 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.780577 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.780725 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.780871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.781025 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.781201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.781374 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.781591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.781752 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.781908 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.782062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.782441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.782601 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.782748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.782896 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.783195 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.783362 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.783519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.783685 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.783834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.783981 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.784136 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.784295 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.784443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.784590 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.784736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.784882 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.785036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.785198 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.785347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.785495 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.785653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.785801 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.785947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.786200 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.786366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.786688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.786868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.787141 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.787315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.787475 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.787632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.787788 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.787958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.788107 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.788264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.788413 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.788569 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.788724 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.788872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.789019 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.789176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.789323 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.789471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.789629 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.789785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.789969 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.790247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.790405 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.790555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.790702 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.790848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.791005 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.791154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.791309 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.791466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.791466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.791849 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.791849 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.792165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.792314 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.792604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.792764 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.792920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.793869 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.794033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.794222 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.794375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.794531 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.794680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.794839 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.795223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.795392 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.795551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.795708 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.795865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.796015 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.796162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.796324 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.796472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.796644 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.796983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.797454 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.797670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.797835 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.797994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.798164 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.798320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.798479 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.798638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.798795 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.798945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.799093 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.799240 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.799386 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.799556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.799724 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.799873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.800030 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.800216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.800460 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.800624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.800773 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.800921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.801069 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.801224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.801373 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.801534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.801691 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.801876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.802149 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.802319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.802649 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.802815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.802972 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.803128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.803443 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.803600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.803762 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.803938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.804204 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.804397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.804551 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.804712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.804872 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.805028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.805184 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.805334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.805480 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.805636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.805798 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.805955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.806351 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.806514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.806687 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.806955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.807255 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.807393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.807825 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.807989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808140 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808409 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808505 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808591 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808880 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.808979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809065 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809235 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809322 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809417 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809638 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809638 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.809955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810283 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810368 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810457 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810457 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810705 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810883 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.810969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.811142 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.811236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.811328 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.811414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.811505 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.811637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.811740 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812122 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812380 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812549 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.812925 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813104 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813292 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813524 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813524 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813782 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.813961 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814168 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814349 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814539 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814716 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814801 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814884 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.814979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815264 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815434 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815599 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815694 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815882 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.815973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816058 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816058 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816312 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816486 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816672 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.816840 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817173 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817467 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817644 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817831 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.817931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818039 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818359 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818742 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818910 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.818993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819090 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819281 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819465 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819642 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819820 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.819997 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820252 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820252 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820510 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820678 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820869 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.820962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821048 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821488 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821813 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.821926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822056 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822249 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822434 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822614 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822854 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.822942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823035 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823219 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823394 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823484 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823582 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823739 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823898 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.823982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824078 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824430 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824610 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824702 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824788 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.824973 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825222 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825396 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825582 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825764 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.825939 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826171 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826356 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826449 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826534 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826709 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826900 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.826900 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827232 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827321 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827603 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827781 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.827949 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828131 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828325 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828493 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828864 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.828956 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829040 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829231 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829400 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829565 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829657 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829741 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.829926 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830133 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830410 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830512 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830617 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830809 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.830896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831173 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831283 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831530 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831765 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.831883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832001 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832247 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832476 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832723 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.832959 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833177 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833411 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833639 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.833873 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834445 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834673 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.834902 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835127 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835359 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835591 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835801 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.835969 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836153 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836320 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836500 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836654 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836724 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836814 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.836899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.837385 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.837528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.837670 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.837775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.837861 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.837945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838029 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838215 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838302 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838376 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838570 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.838881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.839082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.839324 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.839411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.839705 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.839980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.840128 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.840317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.840410 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.840639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.840769 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.841024 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.841132 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.841346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.841438 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.841667 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.841757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.841982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.842084 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.842325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.842525 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.842644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.842846 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.842954 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.843164 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.843278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.843479 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.843618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.843789 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.843948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.844095 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.844281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.844415 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.844620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.844727 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.844948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.845044 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.845269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.845411 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.845589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.845695 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.845911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.846013 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.846253 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.846347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.846580 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.846685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.846912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.847011 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.847228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.847456 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.847604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.847740 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.847840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.848006 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.848153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.848318 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.848468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.848628 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.848783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.848952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.849099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.849275 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.849413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.849934 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.850070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.850299 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.850394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.850619 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.850721 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.850929 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.851020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.851255 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.851354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.851579 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.851672 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.851892 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.851982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.852209 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.852309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.852516 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.852609 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.852840 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.853093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.853183 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.853413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.853515 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.853752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.853844 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.854080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.854193 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.854433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.854542 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.854755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.854847 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.855080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.855183 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.855413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.855523 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.855755 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.855859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.856010 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.856110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.856395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.856498 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.856714 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.856813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.857084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.857185 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.857340 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.857448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.857646 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.857751 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.857949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.858044 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.858287 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.858382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.858598 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.858698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.858902 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.859147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.859241 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.859504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.859596 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.859805 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.859896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.860127 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.860227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.860440 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.860540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.860762 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.860862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.861074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.861166 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.861380 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.861471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.861700 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.861792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.862008 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.862166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.862338 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.862430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.862642 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.862747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.862946 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.863047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.863259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.863350 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.863576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.863681 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.863889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.863990 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.864195 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.864287 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.864508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.864613 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.864816 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.864909 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.865145 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.865244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.865452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.865557 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.865791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.865936 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.866063 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.866217 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.866399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.866492 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.866704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.866797 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.867011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.867112 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.867313 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.867405 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.867617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.867797 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.867919 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.868058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.868222 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.868315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.868524 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.868616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.868831 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.868923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.869134 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.869228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.869436 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.869578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.869738 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.869894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.870058 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.870243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.870386 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.870574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.870708 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.870885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.871016 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.871192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.871320 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.871515 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.871613 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.871830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.872084 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.872213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.872624 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.872717 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.872811 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.872907 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.873017 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.873237 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.873479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.873572 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.873810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.873911 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.874182 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.874383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.874489 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.874727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.874834 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.875056 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.875155 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.875394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.875486 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.875703 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.875803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.876014 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.876116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.876328 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.876428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.876635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.876734 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.876955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.877047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.877270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.877518 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.877618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.877850 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.877955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.878191 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.878287 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.878513 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.878621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.878824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.878923 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.879136 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.879235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.879446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.879560 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.879758 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.879849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.880067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.880156 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.880378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.880473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.880688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.880788 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.881003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.881097 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.881316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.881417 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.881633 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.881738 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.881961 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.882052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.882304 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.882406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.882620 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.882720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.882933 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.883039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.883243 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.883342 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.883554 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.883645 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.883867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.883976 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.884180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.884271 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.884486 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.884584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.884796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.884897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.885106 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.885198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.885412 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.885511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.885717 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.885811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.886032 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.886184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.886424 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.886524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.886742 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.886841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.887053 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.887151 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.887363 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.887459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.887745 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.887846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.888198 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.888317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.888579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.888776 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.888911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.889224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.889324 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.889560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.889845 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.889953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.890198 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.890309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.890522 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.890628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.890864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.891084 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.891223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.891406 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.891505 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.891744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.891923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.892074 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.892166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.892386 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.892478 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.892694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.892795 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.893007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.893107 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.893324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.893415 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.893636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.893736 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.893949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.894042 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.894284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.894378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.894593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.894698 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.894893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.894991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.895198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.895289 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.895505 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.895610 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.895806 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.895905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.896140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.896257 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.896415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.896519 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.896723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.896953 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.897048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.897300 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.897416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.897616 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.897727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.897940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.898094 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.898264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.898382 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.898568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.898664 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.898898 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.898989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.899219 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.899321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.899529 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.899629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.899835 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.899933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.900149 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.900243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.900458 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.900558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.900761 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.900856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.901064 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.901167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.901372 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.901470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.901680 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.901772 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.901981 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.902076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.902316 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.902410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.902618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.902719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.902943 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.903035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.903330 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.903432 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.903636 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.903744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.903944 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.904120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.904306 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.904393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.904542 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.904649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.904843 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.904944 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.905144 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.905236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.905446 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.905540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.905752 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.905851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.906051 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.906163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.906445 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.906610 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.906756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.906855 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.907069 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.907169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.907394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.907493 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.907707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.907800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.908009 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.908134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.908318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.908411 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.908626 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.908730 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.908926 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.909033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.909234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.909334 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.909548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.909686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.909867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.909973 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.910214 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.910310 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.910531 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.910624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.910857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.910957 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.911175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.911274 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.911504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.911704 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.911833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.912038 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.912183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.912354 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.912500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.912687 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.912854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.913013 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.913187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.913318 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.913509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.913609 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.913823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.913923 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.914154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.914249 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.914404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:29:13.914539 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.914850 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.915156 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.915462 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.915767 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.916072 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.916378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.916688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.917084 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.917398 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.917707 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.918011 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.918355 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.918662 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.919111 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.919460 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.919779 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.920095 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.920410 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.920724 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.921031 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.921339 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.921649 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.921954 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.922290 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.922620 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.922931 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.923230 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.923648 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.923958 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.924275 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.924591 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.924899 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.925215 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.925531 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.925838 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.926181 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.926492 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.926821 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.927154 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.927479 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.927799 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.928102 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.928404 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.928750 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.929010 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.929324 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.929629 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.929928 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.930257 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.930564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.930865 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.931166 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.931466 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.931764 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.932067 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.932365 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.932663 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.932960 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.933258 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.933555 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.933853 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.934179 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.934528 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.934832 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.935131 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.935432 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.935731 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.936060 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.936392 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.936713 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.937034 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.937343 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.937662 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.937969 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.938312 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.938638 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.938949 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.939256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.939587 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.939985 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.940199 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.940511 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.940819 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.941127 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.941434 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.941757 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.942078 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.942403 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.942728 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.943039 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.943355 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.943667 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.943973 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.944296 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.944605 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.944908 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.945211 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.945517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.945822 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.946151 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.946464 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.946771 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.947083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.947398 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.947720 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.948042 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.948350 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.948673 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.948992 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.949331 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.949640 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.949982 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.950464 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.950781 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.951094 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.951398 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 15:29:13.951637 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 15:29:13.976466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Registered counter for database nova_api Sep 13 15:29:14.000770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.008097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.012604 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO dbcounter [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Registered counter for database nova_api Sep 13 15:29:14.033391 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_db.sqlalchemy.engines [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.040590 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writer thread running {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.066039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.context [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6341116c-714b-4fb7-baa1-e332de6a8c49(cell1) {{(pid=120658) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 15:29:14.070188 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:29:14.070722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:29:14.072327 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:29:14.073070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:29:14.073535 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:29:14.075602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:29:14.077644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Registered counter for database nova_cell0 Sep 13 15:29:14.081709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Registered counter for database nova_cell1 Sep 13 15:29:14.089507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.091739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.098152 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.context [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6341116c-714b-4fb7-baa1-e332de6a8c49(cell1) {{(pid=120659) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 15:29:14.098308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.099476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.102562 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:29:14.103020 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:29:14.104578 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:29:14.105313 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:29:14.105755 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:29:14.108007 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:29:14.110018 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO dbcounter [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Registered counter for database nova_cell0 Sep 13 15:29:14.114143 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO dbcounter [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Registered counter for database nova_cell1 Sep 13 15:29:14.121504 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_db.sqlalchemy.engines [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.124299 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_db.sqlalchemy.engines [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.129465 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writer thread running {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.131956 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writer thread running {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.248192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Registered counter for database nova_cell0 Sep 13 15:29:14.254879 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.259650 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.281737 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO dbcounter [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Registered counter for database nova_cell0 Sep 13 15:29:14.291092 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_db.sqlalchemy.engines [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 15:29:14.296434 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writer thread running {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 15:29:14.576370 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:29:14.583769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:29:14.611974 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: WARNING keystonemiddleware.auth_token [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:29:14.619300 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: WARNING keystonemiddleware.auth_token [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:29:14.930454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:29:14.937159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-c14b5cee-c86a-4456-a038-62b51f231646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:29:14.942438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5607516a19c0 pid: 120658 (default app) Sep 13 15:29:14.964882 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: WARNING keystonemiddleware.auth_token [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 15:29:14.971231 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: WARNING keystonemiddleware.auth_token [None req-d63f1bce-7935-4829-8089-dc775b4f8e2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 15:29:14.976815 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5607516a19c0 pid: 120659 (default app) Sep 13 15:29:51.388507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:51.396873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:51.397825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:51.399217 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:53.106617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fb46f144-8e04-46d4-aae4-9aa5a208c6de tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Action: 'create', calling method: .version_select at 0x7f4bc0569430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1667946701", "metadata": {"Type": "work"}}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fb46f144-8e04-46d4-aae4-9aa5a208c6de tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Request method failure captured: Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 122 Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKHvBq00BQwf7BiG__Lu7pBeOsufZ1cGJmvZYZUmEt_9j7mbyvvQMfSBGBYWeLrpeTXTGPJVej8qs243myMF8UyDjcWkR0Ssk9dRpcLS4mEEYXGs-l60WcTqqlT6aZ9oWKd8-ALAb63lf__nbOe7lDi5SsXWG89SsU8SDV9f3iMDR64 Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:29:53.132353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}] Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: ffb3221fa4bd48b7af9359b9d59be5ca Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1667946701", "metadata": {"Type": "work"}}} Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:29:53.134007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1667946701', 'metadata': {'Type': 'work'}}}} Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise error Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:29:53.135093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 15:29:53.136685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 15:29:53.138205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 15:29:53.138205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.139162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fb46f144-8e04-46d4-aae4-9aa5a208c6de tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:29:53.140304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fb46f144-8e04-46d4-aae4-9aa5a208c6de tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.780532 Sep 13 15:29:53.147548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 13 15:29:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1789 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 15:29:53.443210 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-19dc7cf6-d658-4efb-a158-ac2b686d6146 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Action: 'create', calling method: .version_select at 0x7f4bc06184c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1617401127", "metadata": {"Type": "work"}}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-19dc7cf6-d658-4efb-a158-ac2b686d6146 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Request method failure captured: Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept: application/json Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept-Encoding: identity Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Connection: close Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Length: 120 Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Type: application/json Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Host: 10.222.0.16 Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Openstack-System-Scope: None Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: User-Agent: python-urllib3/1.26.12 Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Auth-Token: gAAAAABjIKHvBq00BQwf7BiG__Lu7pBeOsufZ1cGJmvZYZUmEt_9j7mbyvvQMfSBGBYWeLrpeTXTGPJVej8qs243myMF8UyDjcWkR0Ssk9dRpcLS4mEEYXGs-l60WcTqqlT6aZ9oWKd8-ALAb63lf__nbOe7lDi5SsXWG89SsU8SDV9f3iMDR64 Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Id: None Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Name: None Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Identity-Status: Confirmed Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Is-Admin-Project: True Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Id: default Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Name: Default Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Role: reader,member Sep 13 15:29:53.452744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Roles: reader,member Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}] Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Id: default Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Name: Default Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Id: ffb3221fa4bd48b7af9359b9d59be5ca Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Name: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1617401127", "metadata": {"Type": "work"}}} Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: method: Sep 13 15:29:53.454826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1617401127', 'metadata': {'Type': 'work'}}}} Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise error Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi '0' Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:29:53.455868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 15:29:53.457517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 15:29:53.458857 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 15:29:53.458857 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.459905 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-19dc7cf6-d658-4efb-a158-ac2b686d6146 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:29:53.461307 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-19dc7cf6-d658-4efb-a158-ac2b686d6146 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.307258 Sep 13 15:29:53.462419 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 13 15:29:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 15:29:53.474906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0d2e1293-86e2-423b-bcb5-93012c8d6535 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Action: 'create', calling method: .version_select at 0x7f4bc0569dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1478378164", "metadata": {"Type": "work"}}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0d2e1293-86e2-423b-bcb5-93012c8d6535 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Request method failure captured: Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 119 Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKHvBq00BQwf7BiG__Lu7pBeOsufZ1cGJmvZYZUmEt_9j7mbyvvQMfSBGBYWeLrpeTXTGPJVej8qs243myMF8UyDjcWkR0Ssk9dRpcLS4mEEYXGs-l60WcTqqlT6aZ9oWKd8-ALAb63lf__nbOe7lDi5SsXWG89SsU8SDV9f3iMDR64 Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:29:53.479813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}] Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: ffb3221fa4bd48b7af9359b9d59be5ca Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1478378164", "metadata": {"Type": "work"}}} Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:29:53.481373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1478378164', 'metadata': {'Type': 'work'}}}} Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise error Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi '' Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:29:53.482379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 15:29:53.483933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 15:29:53.485253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 15:29:53.485253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:53.486965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0d2e1293-86e2-423b-bcb5-93012c8d6535 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:29:53.492106 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0d2e1293-86e2-423b-bcb5-93012c8d6535 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023329 Sep 13 15:29:53.499910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 13 15:29:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 15:29:53.506400 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-bdc65250-1ac7-41cd-a582-b354936728fb tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Calling method '.version_select at 0x7f4bc057e700>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:29:53.623062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_api:SELECT=3 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:53.635952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=3 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:53.646888 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=3 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:53.649822 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=3 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:29:54.660772 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.wsgi [None req-bdc65250-1ac7-41cd-a582-b354936728fb tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] HTTP exception thrown: Volume tempest-invalid-965181063 could not be found. Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-bdc65250-1ac7-41cd-a582-b354936728fb tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Request method failure captured: Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-965181063 HTTP/1.1 Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept: application/json Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept-Encoding: identity Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Connection: close Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Length: 0 Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Type: application/json Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Host: 10.222.0.16 Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Openstack-System-Scope: None Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: User-Agent: python-urllib3/1.26.12 Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Auth-Token: gAAAAABjIKHvBq00BQwf7BiG__Lu7pBeOsufZ1cGJmvZYZUmEt_9j7mbyvvQMfSBGBYWeLrpeTXTGPJVej8qs243myMF8UyDjcWkR0Ssk9dRpcLS4mEEYXGs-l60WcTqqlT6aZ9oWKd8-ALAb63lf__nbOe7lDi5SsXWG89SsU8SDV9f3iMDR64 Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Id: None Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Name: None Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Identity-Status: Confirmed Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Is-Admin-Project: True Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Id: default Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Name: Default Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Role: reader,member Sep 13 15:29:54.667881 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Roles: reader,member Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}] Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Id: default Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Name: Default Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Id: ffb3221fa4bd48b7af9359b9d59be5ca Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Name: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: method: Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: exception: Volume tempest-invalid-965181063 could not be found. Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: action_args: {'id': 'tempest-invalid-965181063'} Sep 13 15:29:54.669544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-965181063 could not be found. (HTTP 404) (Request-ID: req-4b9e1209-050d-477b-a974-10dca0b60048) Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:54.670800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 15:29:54.673371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-965181063 could not be found. Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:29:54.676004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-965181063 could not be found. Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-965181063 could not be found. Sep 13 15:29:54.679081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:54.680852 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-bdc65250-1ac7-41cd-a582-b354936728fb tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Returning 404 to user: Volume tempest-invalid-965181063 could not be found. {{(pid=120659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:29:54.682037 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-bdc65250-1ac7-41cd-a582-b354936728fb tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-965181063" status: 404 len: 98 microversion: 2.1 time: 1.180672 Sep 13 15:29:54.683161 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1215 bytes} [Tue Sep 13 15:29:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-965181063 => generated 98 bytes in 1183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 13 15:29:54.692583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0902e534-e5e3-45e8-b768-63a490187091 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003852 Sep 13 15:29:54.697304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1140 bytes} [Tue Sep 13 15:29:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 15:29:54.703354 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-281323d2-a602-4d4c-a748-0ac3a96a9fe1 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004720 Sep 13 15:29:54.704106 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1137 bytes} [Tue Sep 13 15:29:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 13 15:29:54.713901 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5ce57830-82a2-433a-a8f1-c63f95de48b3 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Calling method '.version_select at 0x7f4bc0425430>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:29:55.419595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-5ce57830-82a2-433a-a8f1-c63f95de48b3 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] HTTP exception thrown: Volume 14394142-95b1-4f51-b12e-d185938483ea could not be found. Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5ce57830-82a2-433a-a8f1-c63f95de48b3 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Request method failure captured: Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/os-volumes/14394142-95b1-4f51-b12e-d185938483ea HTTP/1.1 Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKHvBq00BQwf7BiG__Lu7pBeOsufZ1cGJmvZYZUmEt_9j7mbyvvQMfSBGBYWeLrpeTXTGPJVej8qs243myMF8UyDjcWkR0Ssk9dRpcLS4mEEYXGs-l60WcTqqlT6aZ9oWKd8-ALAb63lf__nbOe7lDi5SsXWG89SsU8SDV9f3iMDR64 Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:29:55.423346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}] Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: ffb3221fa4bd48b7af9359b9d59be5ca Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Volume 14394142-95b1-4f51-b12e-d185938483ea could not be found. Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '14394142-95b1-4f51-b12e-d185938483ea'} Sep 13 15:29:55.424347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14394142-95b1-4f51-b12e-d185938483ea could not be found. (HTTP 404) (Request-ID: req-adcb1293-4178-46ae-b1dd-f4c9d5b15c4a) Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:55.424898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 15:29:55.425777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14394142-95b1-4f51-b12e-d185938483ea could not be found. Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 15:29:55.426838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14394142-95b1-4f51-b12e-d185938483ea could not be found. Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14394142-95b1-4f51-b12e-d185938483ea could not be found. Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5ce57830-82a2-433a-a8f1-c63f95de48b3 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Returning 404 to user: Volume 14394142-95b1-4f51-b12e-d185938483ea could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5ce57830-82a2-433a-a8f1-c63f95de48b3 tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/14394142-95b1-4f51-b12e-d185938483ea" status: 404 len: 109 microversion: 2.1 time: 0.714890 Sep 13 15:29:55.433141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:29:54 2022] DELETE /compute/v2.1/os-volumes/14394142-95b1-4f51-b12e-d185938483ea => generated 109 bytes in 722 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:29:55.441117 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b8273a63-324a-4a94-a7bf-2bfc0b8bb1dd tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Calling method '.version_select at 0x7f4bc03ce0d0>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:29:55.475332 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.wsgi [None req-b8273a63-324a-4a94-a7bf-2bfc0b8bb1dd tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] HTTP exception thrown: Volume 1706daf8-2f8b-419b-aee7-b63bea0e28f5 could not be found. Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b8273a63-324a-4a94-a7bf-2bfc0b8bb1dd tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Request method failure captured: Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: request: GET /compute/v2.1/os-volumes/1706daf8-2f8b-419b-aee7-b63bea0e28f5 HTTP/1.1 Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept: application/json Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept-Encoding: identity Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Connection: close Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Length: 0 Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Type: application/json Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Host: 10.222.0.16 Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Openstack-System-Scope: None Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: User-Agent: python-urllib3/1.26.12 Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Auth-Token: gAAAAABjIKHvBq00BQwf7BiG__Lu7pBeOsufZ1cGJmvZYZUmEt_9j7mbyvvQMfSBGBYWeLrpeTXTGPJVej8qs243myMF8UyDjcWkR0Ssk9dRpcLS4mEEYXGs-l60WcTqqlT6aZ9oWKd8-ALAb63lf__nbOe7lDi5SsXWG89SsU8SDV9f3iMDR64 Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Id: None Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Name: None Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Identity-Status: Confirmed Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Is-Admin-Project: True Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Id: default Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Name: Default Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Role: reader,member Sep 13 15:29:55.477812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Roles: reader,member Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c27cf51a0b3474d84d16e6f53cf938b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c27cf51a0b3474d84d16e6f53cf938b"}]}] Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Id: 6c27cf51a0b3474d84d16e6f53cf938b Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Name: tempest-VolumesNegativeTest-2095433568 Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Id: default Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Name: Default Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Id: ffb3221fa4bd48b7af9359b9d59be5ca Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Name: tempest-VolumesNegativeTest-2095433568-project Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: method: Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: exception: Volume 1706daf8-2f8b-419b-aee7-b63bea0e28f5 could not be found. Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: action_args: {'id': '1706daf8-2f8b-419b-aee7-b63bea0e28f5'} Sep 13 15:29:55.478879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1706daf8-2f8b-419b-aee7-b63bea0e28f5 could not be found. (HTTP 404) (Request-ID: req-2c910744-ee55-443f-8f94-d679c2a93415) Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:55.479449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:29:55.480256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1706daf8-2f8b-419b-aee7-b63bea0e28f5 could not be found. Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 15:29:55.481897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1706daf8-2f8b-419b-aee7-b63bea0e28f5 could not be found. Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1706daf8-2f8b-419b-aee7-b63bea0e28f5 could not be found. Sep 13 15:29:55.482951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:29:55.485767 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b8273a63-324a-4a94-a7bf-2bfc0b8bb1dd tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] Returning 404 to user: Volume 1706daf8-2f8b-419b-aee7-b63bea0e28f5 could not be found. {{(pid=120659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:29:55.486853 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b8273a63-324a-4a94-a7bf-2bfc0b8bb1dd tempest-VolumesNegativeTest-2095433568 tempest-VolumesNegativeTest-2095433568-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1706daf8-2f8b-419b-aee7-b63bea0e28f5" status: 404 len: 109 microversion: 2.1 time: 0.050107 Sep 13 15:29:55.487537 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:29:55 2022] GET /compute/v2.1/os-volumes/1706daf8-2f8b-419b-aee7-b63bea0e28f5 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:30:02.037175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a497e351-9ed0-44c9-87f5-dc59ea7b48a3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'create', calling method: .version_select at 0x7f4bc03ace50>, body: {"keypair": {"name": "tempest-keypair-751649093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTwhuRSn6kR5hqQJL5sojVPMKvZpW1goX1CT1EZVXewsdqP+QOHPhmaR2G6avVoAZ1byOpro3RCCst0PAzoR7cOy8ObmbPJFJlfuazmjJSAJdRZsmK2tsH8UyJInhvL5Q=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:02.149770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-a497e351-9ed0-44c9-87f5-dc59ea7b48a3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for project 597b9e023e324874ac5f24ee571d1f66. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:02.162400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-a497e351-9ed0-44c9-87f5-dc59ea7b48a3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for user c02aec8271af4bf7aea728ff92fa555b and project 597b9e023e324874ac5f24ee571d1f66. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:02.249842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a497e351-9ed0-44c9-87f5-dc59ea7b48a3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.546072 Sep 13 15:30:02.251394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 5/9] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:30:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:05.921590 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-277123579", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65fb418c-15cf-4bb3-9028-4f3e8b987c36"}], "security_groups": [{"name": "tempest-securitygroup--1916684813"}], "key_name": "tempest-keypair-751649093", "user_data": "}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:06.448778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.network.neutron [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] validate_networks() for [('65fb418c-15cf-4bb3-9028-4f3e8b987c36', None, None, None, None, None)] {{(pid=120659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:30:09.115821 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Flavor limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:30:09.117005 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Image limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:30:09.118242 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Flavor pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:30:09.118812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Image pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:30:09.119394 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:30:09.179548 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:09.183502 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:09.185776 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:09.186847 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:09.190495 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:09.191558 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:09.345625 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for project 597b9e023e324874ac5f24ee571d1f66. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:09.376143 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for user c02aec8271af4bf7aea728ff92fa555b and project 597b9e023e324874ac5f24ee571d1f66. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:09.413756 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Going to run 1 instances... {{(pid=120659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:30:09.417433 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:30:09.430028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-281759363", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "networks": [{"uuid": "853b8391-5bbf-48bb-90af-a48b0e48e5ff"}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:09.607400 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-314ba8bd-a90d-4e1b-9050-7361e832ac01 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.691294 Sep 13 15:30:09.608327 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 5/10] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:30:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 3693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:30:09.637034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] validate_networks() for [('853b8391-5bbf-48bb-90af-a48b0e48e5ff', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:30:09.652801 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-c68f68e7-2322-4886-ad00-c8e8e4a46a67 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:09.662335 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-c68f68e7-2322-4886-ad00-c8e8e4a46a67 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:10.025116 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-c68f68e7-2322-4886-ad00-c8e8e4a46a67 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:10.056838 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-c68f68e7-2322-4886-ad00-c8e8e4a46a67 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1236 microversion: 2.1 time: 0.440850 Sep 13 15:30:10.078019 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:09 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1236 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:11.100176 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-04ea3398-a9eb-4b95-9f47-7453a61a8473 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:11.103597 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-04ea3398-a9eb-4b95-9f47-7453a61a8473 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:11.907846 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-04ea3398-a9eb-4b95-9f47-7453a61a8473 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:11.919415 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-04ea3398-a9eb-4b95-9f47-7453a61a8473 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1236 microversion: 2.1 time: 0.839858 Sep 13 15:30:11.920238 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:11 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1236 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:12.195855 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:12.699174 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b0ff4495-2162-4091-9993-ffc2b882e6a7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'create', calling method: .version_select at 0x7f4bbfa13ca0>, body: {"keypair": {"name": "tempest-keypair-1718268037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhwOpguanrdSXJ/O3e2YCW2lNbbaca3yQ62jnOnpFzfNeOJ3rgcLb1ktPCzZ0t9PD2kzHAGc8dOV/QcQ8T+Aql+AKzVyGc9IU80I1YUvrVVrz1v6S8zB96HtRedpRnq9Q=="}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:12.795276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:30:12.795838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:30:12.796469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:30:12.797665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:30:12.798850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:30:12.820040 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-b0ff4495-2162-4091-9993-ffc2b882e6a7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'key_pairs'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:12.827640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:12.827640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:12.850787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:12.852036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:12.859395 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-b0ff4495-2162-4091-9993-ffc2b882e6a7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for user 515e0f8a3a234deba5f909271b303abb and project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'key_pairs'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:12.863760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:12.864213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:12.946664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Getting quotas for project 836a885e5c97498db1721adb1a22a05f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:12.953615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Getting quotas for user c8dcc087badb43b7a18d294a6e316fe0 and project 836a885e5c97498db1721adb1a22a05f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:12.996688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b0ff4495-2162-4091-9993-ffc2b882e6a7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.962926 Sep 13 15:30:12.999065 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 8/13] 10.222.0.16 () {62 vars in 1200 bytes} [Tue Sep 13 15:30:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 967 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 15:30:13.041769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:30:13.053945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:30:13.261771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b1b4aecc-d06d-4ae8-a677-528066ecbb7a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.723446 Sep 13 15:30:13.270063 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 6/14] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:30:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:30:13.294378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:13.296889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:13.341861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:13.342629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:13.343681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:13.347213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:13.350344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:13.351586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:13.751208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:13.776380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a5e4f39d-5e1c-4037-b4f3-077e47b70d5a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1232 microversion: 2.1 time: 0.503972 Sep 13 15:30:13.779510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:13 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1232 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:13.798089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-913dc3e5-b985-43c7-8321-657d24cf83dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:13.800281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-913dc3e5-b985-43c7-8321-657d24cf83dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:13.904552 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1632416528", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:14.020584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-913dc3e5-b985-43c7-8321-657d24cf83dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:14.061483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-913dc3e5-b985-43c7-8321-657d24cf83dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1214 microversion: 2.1 time: 0.279281 Sep 13 15:30:14.064551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:13 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:14.097214 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.network.neutron [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] validate_networks() for [('727aeb83-9e0c-4e35-a2e7-ffb5dc5e6a50', None, None, None, None, None)] {{(pid=120659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:30:14.804183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:14.805950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:14.822045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:14.823755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:14.825028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:14.827670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:14.830649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:14.831314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:15.203550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:15.219157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-42c44df3-cd43-41c2-b24c-251766265cf2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1306 microversion: 2.1 time: 0.418994 Sep 13 15:30:15.221251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:14 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1306 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:15.230503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a322b55-b228-4a4f-9237-c522b62a86c1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:15.231766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2a322b55-b228-4a4f-9237-c522b62a86c1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:15.329133 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Flavor limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:30:15.329717 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Image limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:30:15.330008 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Flavor pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:30:15.330650 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Image pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:30:15.331067 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:30:15.385275 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:15.385937 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:15.386488 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:15.387242 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:15.387700 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:15.388124 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:15.466830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2a322b55-b228-4a4f-9237-c522b62a86c1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:15.481892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a322b55-b228-4a4f-9237-c522b62a86c1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1214 microversion: 2.1 time: 0.257604 Sep 13 15:30:15.499632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:15 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1214 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:15.517427 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:15.529508 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for user 97189d5c87c94be2bef7cff79c471c7d and project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:15.559002 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Going to run 1 instances... {{(pid=120659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:30:15.564540 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:30:15.701958 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-6367c31f-4e69-4d3e-a0ea-68774340a21b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.698953 Sep 13 15:30:15.713111 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 9/19] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:30:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:30:15.719598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-57adbd2b-7074-4d24-8a8c-20d42f044306 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:15.720696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-57adbd2b-7074-4d24-8a8c-20d42f044306 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:15.867312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-57adbd2b-7074-4d24-8a8c-20d42f044306 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:15.894272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-57adbd2b-7074-4d24-8a8c-20d42f044306 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1222 microversion: 2.1 time: 0.181517 Sep 13 15:30:15.895264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 11/20] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:15 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:16.228511 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-700604498", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:16.249176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:16.249799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:16.260712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:16.261826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:16.263736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:16.266005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:16.266764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:16.267446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:16.436120 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.network.neutron [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] validate_networks() for [('727aeb83-9e0c-4e35-a2e7-ffb5dc5e6a50', None, None, None, None, None)] {{(pid=120659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:30:16.826378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:16.883361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f2f53e3a-344d-45ea-98bd-e36a9ad9ae55 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1294 microversion: 2.1 time: 0.638755 Sep 13 15:30:16.884681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 12/21] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:16 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1294 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:16.893680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:16.895679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:16.910160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:16.912451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:16.918304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:16.920289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:16.920923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:16.923360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:17.404653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:17.430451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5abfabe5-5b08-4f36-b54c-7eabcf781519 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1274 microversion: 2.1 time: 0.541762 Sep 13 15:30:17.444259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 13/22] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:16 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1274 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:17.909870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:17.910717 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:17.927877 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:17.939029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:17.942685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:17.946812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:17.947600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:17.948406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:18.529268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:18.588094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e7cbc7ef-a853-41b6-be5d-3cb0b0e619d7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1294 microversion: 2.1 time: 0.671250 Sep 13 15:30:18.593723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 14/23] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:17 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1294 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:18.617138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:18.617759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:18.650439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:18.651769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:18.653002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:18.658638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:18.659750 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:18.661399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:19.274342 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:19.284226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1273c952-44fb-4773-96cc-c6cf36ccc55b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1272 microversion: 2.1 time: 0.687028 Sep 13 15:30:19.291713 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 15/24] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:18 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1272 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:19.616778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:19.617756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:19.648667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:19.650796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:19.651503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:19.653700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:19.655081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:19.656033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:20.071855 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:20.083911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-487e9dae-8a93-4d9e-acf5-32d3ce5ee189 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1294 microversion: 2.1 time: 0.471440 Sep 13 15:30:20.086229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 16/25] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:19 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1294 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:20.318468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:20.319205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:20.341727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:20.346919 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:20.347712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:20.353176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:20.353928 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:20.354663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:20.459814 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Flavor limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:30:20.460356 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Image limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:30:20.460714 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Flavor pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:30:20.461123 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Image pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:30:20.461580 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:30:20.489996 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:20.496443 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:20.496901 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:20.500663 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:20.503272 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:20.504588 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:20.604582 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:20.618734 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for user 97189d5c87c94be2bef7cff79c471c7d and project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:20.688766 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Going to run 1 instances... {{(pid=120659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:30:20.697134 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:30:20.735213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:20.756420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-48ace992-fe4f-4c68-a8fe-e05e4d03ae1a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1272 microversion: 2.1 time: 0.436373 Sep 13 15:30:20.757656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 17/26] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:20 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1272 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:20.900548 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-078cc9cc-2b4a-4a23-b521-d0bc317daf43 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.675061 Sep 13 15:30:20.905461 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 10/27] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:30:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 4683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:30:20.918828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-917cbd5b-4e6b-4b2b-9587-3823d2e1e925 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:20.919463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-917cbd5b-4e6b-4b2b-9587-3823d2e1e925 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:21.125867 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:21.127623 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:21.161408 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:21.161922 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:21.162373 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:21.165587 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:21.169045 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:21.169895 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:21.296056 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-917cbd5b-4e6b-4b2b-9587-3823d2e1e925 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:21.308031 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-917cbd5b-4e6b-4b2b-9587-3823d2e1e925 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1221 microversion: 2.1 time: 0.393817 Sep 13 15:30:21.313486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 18/28] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:20 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1221 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:21.785235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:21.788194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:21.803840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:21.805417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:21.806917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:21.809400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:21.811143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:21.813956 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:21.919664 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:21.955568 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-41950223-a64e-4a60-b500-c83ef97991d8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1294 microversion: 2.1 time: 0.846577 Sep 13 15:30:21.959600 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 11/29] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:21 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1294 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:22.244359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:22.272625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-93d5256c-4c82-42aa-bb41-69c94a1671f7 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1272 microversion: 2.1 time: 0.494278 Sep 13 15:30:22.276854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 19/30] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:21 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1272 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:22.346315 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:22.347328 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:22.381577 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:22.391898 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:22.398680 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:22.400197 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:22.408756 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:22.409977 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:22.989701 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1444074529", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a87f0b4-b557-4ae0-99ca-c1b34aa8ea5c"}], "security_groups": [{"name": "tempest-securitygroup--844351988"}], "key_name": "tempest-keypair-1718268037", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:23.060598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:23.069468 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:23.090851 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-66117dc2-b342-4cf4-938f-50b4c5446a75 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1225 microversion: 2.1 time: 0.749641 Sep 13 15:30:23.095044 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 12/31] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:22 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1225 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:23.114374 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:23.115093 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:23.145160 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:23.148857 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:23.149364 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:23.156365 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:23.157368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:23.166219 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:24.304508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] validate_networks() for [('0a87f0b4-b557-4ae0-99ca-c1b34aa8ea5c', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:30:24.849469 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:24.881859 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8499b1b8-cb7e-4451-978c-2f95e1105d8b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 1.778479 Sep 13 15:30:24.885799 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 13/32] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:23 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:24.903000 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:24.916602 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:24.933353 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:24.942796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:24.946790 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:24.951857 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:24.952893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:24.954864 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:26.032399 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:26.058510 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-5f09d53a-9f20-41ae-960c-582a30c10e80 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 1.166620 Sep 13 15:30:26.081207 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 14/33] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:24 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:26.097204 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:26.098180 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:26.118579 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:26.119131 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:26.119571 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:26.120760 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:26.124107 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:26.124947 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:27.366869 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:27.404540 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-556f4765-5687-4aed-a48a-00b3a761a4a8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1279 microversion: 2.1 time: 1.316976 Sep 13 15:30:27.405962 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 15/34] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:26 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1279 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:27.412299 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:27.413598 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:27.438619 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:27.439753 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:27.440497 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:27.441426 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:27.442089 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:27.442792 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:28.215440 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:28.257657 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b06e7c82-b574-4652-bb5b-d3b0e0934432 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.840857 Sep 13 15:30:28.262429 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 16/35] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:27 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:28.316058 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:28.319069 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:28.379895 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:28.395154 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:28.397570 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:28.398671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:28.399249 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:28.399866 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:28.535890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:30:28.536397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:30:28.536853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:30:28.537449 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:30:28.537940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:30:28.579734 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:28.580279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:28.583846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:28.591360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:28.598487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:28.600574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:28.669212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:28.680556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for user 515e0f8a3a234deba5f909271b303abb and project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:28.716435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:30:28.722308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:30:28.865897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-71e3f550-1080-45a0-ab03-dfd395b29fde tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.881392 Sep 13 15:30:28.876288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 20/36] 10.222.0.16 () {62 vars in 1188 bytes} [Tue Sep 13 15:30:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 5892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 15:30:28.897811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:28.900223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:28.929709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:28.933733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:28.934590 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:28.937031 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:28.940936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:28.941596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:29.489662 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:29.512429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-14e9b872-be00-479a-a5ce-20e769509dd8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1279 microversion: 2.1 time: 0.630910 Sep 13 15:30:29.515197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 21/37] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:28 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1279 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:29.543877 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-520fdf6c-b3bb-4cf7-ac1b-183da9922378 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:29.546045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-520fdf6c-b3bb-4cf7-ac1b-183da9922378 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:30.060982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-520fdf6c-b3bb-4cf7-ac1b-183da9922378 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:30.073890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-520fdf6c-b3bb-4cf7-ac1b-183da9922378 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:30.075565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-520fdf6c-b3bb-4cf7-ac1b-183da9922378 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:30.079492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-520fdf6c-b3bb-4cf7-ac1b-183da9922378 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1282 microversion: 2.20 time: 0.559585 Sep 13 15:30:30.087306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 22/38] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:29 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1282 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:30.101288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:30.102595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:30.121993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:30.123970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:30.125820 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:30.128951 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:30.129987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:30.130677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:30.141521 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:30.157542 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-6d743bc9-432c-41a4-8623-4f0856357bd5 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 1.890029 Sep 13 15:30:30.172990 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 17/39] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:28 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:30.553581 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:30.554509 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:30.558095 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=6 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:30.569669 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:30.570680 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:30.571893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:30.573864 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:30.574598 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:30.577537 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:30.670695 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=26 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:30.927159 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:30.943580 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-0b249741-4859-4cb7-a6a1-8cd9df724400 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1279 microversion: 2.1 time: 0.404525 Sep 13 15:30:30.968285 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 18/40] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:30 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1279 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:31.125037 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:31.136349 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:31.173483 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:31.174648 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:31.177187 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:31.178728 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:31.189985 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:31.190523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:31.195461 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:31.206057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9f64ae18-355c-4a85-ae18-da33c5b4f4f6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 1.116877 Sep 13 15:30:31.213625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:30 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:31.243427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:31.247022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:31.269107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:31.270912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:31.271516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:31.274331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:31.275553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:31.277326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:31.577125 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:31.595112 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:31.618961 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:31.622029 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b7693fdb-bfb0-4ffa-8710-59f50c4834c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1334 microversion: 2.20 time: 0.507988 Sep 13 15:30:31.645777 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 19/42] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:31 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1334 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:30:32.126921 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-1729f257-d309-41f9-8035-972f8a23376e req-4e40b1e7-ac20-41b3-b6da-e14ed7d7e86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05da62b3-a8ec-4148-b17b-2c08f0e0d2ae", "tag": "8c605c1b-be6e-4bf8-8d00-af61d57887b0"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:32.165715 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-1729f257-d309-41f9-8035-972f8a23376e req-4e40b1e7-ac20-41b3-b6da-e14ed7d7e86d service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.166568 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-1729f257-d309-41f9-8035-972f8a23376e req-4e40b1e7-ac20-41b3-b6da-e14ed7d7e86d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.167079 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-1729f257-d309-41f9-8035-972f8a23376e req-4e40b1e7-ac20-41b3-b6da-e14ed7d7e86d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.227601 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-1729f257-d309-41f9-8035-972f8a23376e req-4e40b1e7-ac20-41b3-b6da-e14ed7d7e86d service nova] Creating event network-changed:8c605c1b-be6e-4bf8-8d00-af61d57887b0 for instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae on hv-cinder-85743 Sep 13 15:30:32.233828 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-1729f257-d309-41f9-8035-972f8a23376e req-4e40b1e7-ac20-41b3-b6da-e14ed7d7e86d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 15:30:32.236099 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-1729f257-d309-41f9-8035-972f8a23376e req-4e40b1e7-ac20-41b3-b6da-e14ed7d7e86d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 15:30:32.240584 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.241983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.242452 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.243192 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.243646 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.244069 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.244182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:32.253665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-579d4e04-01bd-48ef-a89e-18cf111266c4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 1.037256 Sep 13 15:30:32.254470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:31 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:32.259531 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:32.260638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:32.263038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:32.271746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.272619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.273275 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.284791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.285401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.286243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.294605 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.compute.rpcapi [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 15:30:32.300806 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] Releasing lock "compute-rpcapi-router" {{(pid=120659) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 15:30:32.371081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3718581f-57dc-4be0-97f5-344580f0c281 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421460 Sep 13 15:30:32.373064 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 20/44] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:32.482790 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-6cde3fcb-a425-446e-963d-172936b8fa41 req-1bbda2d9-9a91-4410-a976-d5cda991ca3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecad0016-167e-481d-bc1a-44f01c614a59", "tag": "678a26e2-4972-4820-8b36-e8ab2402f95d"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:32.509935 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-6cde3fcb-a425-446e-963d-172936b8fa41 req-1bbda2d9-9a91-4410-a976-d5cda991ca3e service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.510549 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-6cde3fcb-a425-446e-963d-172936b8fa41 req-1bbda2d9-9a91-4410-a976-d5cda991ca3e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.511326 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-6cde3fcb-a425-446e-963d-172936b8fa41 req-1bbda2d9-9a91-4410-a976-d5cda991ca3e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.548360 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-6cde3fcb-a425-446e-963d-172936b8fa41 req-1bbda2d9-9a91-4410-a976-d5cda991ca3e service nova] Creating event network-changed:678a26e2-4972-4820-8b36-e8ab2402f95d for instance ecad0016-167e-481d-bc1a-44f01c614a59 on hv-cinder-85743 Sep 13 15:30:32.556969 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-6cde3fcb-a425-446e-963d-172936b8fa41 req-1bbda2d9-9a91-4410-a976-d5cda991ca3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166213 Sep 13 15:30:32.558281 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 21/45] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:32.566338 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:32.567314 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:32.575908 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.576999 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.577641 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.578745 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.581538 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.582391 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.627239 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:32.638760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-298bcefd-4b58-4836-a149-7a689e402694 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.382912 Sep 13 15:30:32.661903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 25/46] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:32 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:32.667833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:32.670747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:32.677759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.678495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.679057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.679916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:32.681989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:32.682535 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:32.787111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:32.798861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:32.800802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:32.802893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a5755273-d5c7-42fc-8057-772a70ab885f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1334 microversion: 2.20 time: 0.139701 Sep 13 15:30:32.807368 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 26/47] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:32 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1334 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:32.830754 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:32.839121 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-a5350150-ecb1-41d4-a1bf-9b80aa69d314 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.278188 Sep 13 15:30:32.839966 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:32 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:33.277245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:33.278367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:33.284514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.285272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.285700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:33.286436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.286886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.287318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:33.429113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:33.438225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-591aef8c-ed23-4cd5-a7bb-052b324a97e6 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.165182 Sep 13 15:30:33.446598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 27/49] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:33 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:33.661874 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:33.663209 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:33.670777 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.671526 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.672177 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:33.673049 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.674897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.675473 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:33.834012 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:33.836201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:33.852709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.854574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.855239 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:33.855610 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:33.856546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.857589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.858308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:33.869366 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-a1e667e6-b153-4367-9aca-4b3220e639a2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.211072 Sep 13 15:30:33.869927 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 23/50] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:33 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:33.893005 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:33.896431 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:33.911955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.912765 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.913192 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:33.913950 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:33.914567 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:33.915137 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:34.010007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:34.021776 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:34.034704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:34.037150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:34.042183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f8999c2e-e04a-4abf-a9c2-698fc68a1d09 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1342 microversion: 2.20 time: 0.215951 Sep 13 15:30:34.043914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 28/51] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:33 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:30:34.090777 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:34.101312 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-74fb6b2e-9c66-40a5-804e-45f77e691dcd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.217879 Sep 13 15:30:34.118062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 24/52] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:33 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:34.406249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3f4ab8-cedc-4b59-a85c-89535bb22caf", "tag": "cdd622f7-1540-4df3-9a58-fc9530ecac1d"}, {"name": "network-changed", "server_uuid": "29ef7238-7280-4c0f-b213-4efdc33bccc0", "tag": "791fe666-c2cb-4d8a-91fa-3927d141b45c"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:34.424085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:34.426552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:34.426995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:34.452888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Creating event network-changed:cdd622f7-1540-4df3-9a58-fc9530ecac1d for instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf on hv-cinder-85743 Sep 13 15:30:34.453558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Creating event network-changed:791fe666-c2cb-4d8a-91fa-3927d141b45c for instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 on hv-cinder-85743 Sep 13 15:30:34.454097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 15:30:34.454524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7cbc30f-dafa-4c44-9257-b24709825612 req-09ce982d-20d6-45cf-a4d2-d8281a6d5a30 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 15:30:34.455557 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:34.456011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:34.456439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:34.457156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:34.457605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:34.458019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:34.465116 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:34.466581 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:34.467372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.compute.rpcapi [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 15:30:34.468260 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] Releasing lock "compute-rpcapi-router" {{(pid=120658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 15:30:34.470609 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:34.479029 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:34.479573 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:34.480164 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:34.481429 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:34.481923 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:34.482383 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:34.489518 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4e63e3b3-e15f-4559-8d59-46b292c8ae6a None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.092107 Sep 13 15:30:34.497067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 29/53] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:34.635296 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:34.652143 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8aedaa30-406b-4e8e-a888-6569f5deed7b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.192112 Sep 13 15:30:34.654061 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 25/54] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:34 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:34.896942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:34.897741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:34.905428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:34.905926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:34.906394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:34.907099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:34.907552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:34.907977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:35.057053 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:35.069222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fa9cb5ac-0869-4f44-83ce-6dba0a03f9af tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.176467 Sep 13 15:30:35.073435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 30/55] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:34 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:35.073587 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:35.073587 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:35.079120 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:35.079710 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:35.080228 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:35.081073 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:35.081778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:35.082432 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:35.125759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:35.127357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:35.134668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:35.136589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:35.138360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:35.139246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:35.139861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:35.141093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:35.162473 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:35.173592 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:35.177756 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:35.179054 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-88c78853-fb38-4786-b9e5-c8a452d42171 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1342 microversion: 2.20 time: 0.114237 Sep 13 15:30:35.179724 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 26/56] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:35 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1342 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:30:35.318686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:35.327151 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-71f1d57a-999c-4787-b6be-17d3b5baedbe tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.205731 Sep 13 15:30:35.327659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 31/57] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:35 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:35.676863 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:35.677870 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:35.686374 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:35.687057 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:35.687796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:35.688566 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:35.689005 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:35.689423 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:35.713491 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:35.846732 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:35.856062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-340ced52-308c-44d0-8b90-30044555a0dc tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.183465 Sep 13 15:30:35.856650 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 27/58] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:35 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:36.092884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:36.093394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:36.100082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.100723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.101224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:36.101971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.102568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.103055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:36.205924 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:36.206969 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:36.213952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.214477 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.215135 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:36.216095 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.216917 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.217573 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:36.239835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:36.251440 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6b18e360-8d25-4925-be75-9a18c73629f3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.162330 Sep 13 15:30:36.252029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:36 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:36.296411 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:36.305930 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:36.307725 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:36.308830 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-0b4c9037-a559-4ff7-84f6-fe32a0f0a517 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1342 microversion: 2.20 time: 0.106928 Sep 13 15:30:36.309393 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 28/60] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:36 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1342 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:36.351266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:36.353711 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:36.360343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.360832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.361258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:36.361944 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.362426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.362846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:36.499593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:36.507519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8e362e95-ac9f-4daa-9f39-c4f528a61db2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.160585 Sep 13 15:30:36.508070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 33/61] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:36 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:36.895460 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:36.895992 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:36.908267 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.909989 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.911122 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:36.912684 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:36.914652 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:36.916259 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:37.274243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:37.276749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:37.283865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:37.284715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:37.285338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:37.286222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:37.287129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:37.287698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:37.391687 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:37.414254 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-e28b1c5d-9b4e-4bba-89c6-09215589e1a9 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.535566 Sep 13 15:30:37.421024 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 29/62] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:36 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:37.441228 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:37.441786 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:37.449279 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:37.449757 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:37.450219 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:37.450916 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:37.451360 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:37.451981 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:37.457956 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:37.466079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3769a898-192d-448f-ac8a-131aa610984e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.195898 Sep 13 15:30:37.467001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 34/63] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:37 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:37.516719 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:37.528300 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:37.529726 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:37.530848 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-e0d943d8-6033-4169-a98c-18658274b065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1340 microversion: 2.20 time: 0.095524 Sep 13 15:30:37.531538 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 30/64] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:37 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1340 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:37.531809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:37.532485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:37.538822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:37.539307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:37.539739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:37.540427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:37.540934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:37.541504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:37.679899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:37.687761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-493b012c-cde8-4ccf-99d4-8f6b8db883dd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.160461 Sep 13 15:30:37.688337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:37 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:38.444067 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:38.445189 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:38.451520 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.452061 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.452666 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.453451 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.454090 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.454735 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.488866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:38.489463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:38.500373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.501004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.501636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.502793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.503440 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.504069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.682538 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:38.691027 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b12103e9-4b48-4288-baa3-da39ece26046 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.251172 Sep 13 15:30:38.692084 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 31/66] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:38 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:38.698720 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:38.699325 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:38.705150 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.705814 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.706296 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.707221 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.707689 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.708090 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.733159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:38.741716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5dfd5c10-244d-430f-a54e-f248e89f025c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.256642 Sep 13 15:30:38.742373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 36/67] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:38 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:38.747194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:38.748019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:38.754347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.755276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.755897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.756890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:38.757343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:38.757762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:38.776872 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:38.785877 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:38.787473 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:38.788659 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-41953a5d-caa0-4a3f-8297-379cd8b4be19 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1340 microversion: 2.20 time: 0.095653 Sep 13 15:30:38.789912 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 32/68] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:38 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:38.894914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:38.903980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c09a1d64-9c17-4802-a82c-04e0932f52b2 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.160447 Sep 13 15:30:38.904765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:38 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:39.715599 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:39.716216 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:39.724271 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:39.724957 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:39.725574 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:39.726744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:39.727785 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:39.728406 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:39.767334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:39.768591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:39.779917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:39.783112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:39.784623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:39.787679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:39.794168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:39.795456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:40.032560 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:40.050795 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-6a0b1530-597a-4e7a-944f-6acb41fdda0b tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.337903 Sep 13 15:30:40.051460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:40.051701 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 33/70] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:39 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:40.061489 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1a8bfe79-3982-4564-b5f4-c8b3c75faf66 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.299479 Sep 13 15:30:40.070549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 38/71] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:39 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:40.072889 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:40.075935 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:40.086422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:40.087042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:40.087560 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:40.088167 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:40.088740 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:40.090356 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:40.091010 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:40.091865 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:40.093983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=22 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:40.096010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:40.096802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:40.097746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:40.098754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:40.099363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:40.100614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:40.201650 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:40.219366 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:40.220848 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:40.223288 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-024e6458-2122-4d84-b255-1b2740e0f702 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1340 microversion: 2.20 time: 0.170618 Sep 13 15:30:40.224728 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 34/72] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:40 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1340 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:40.283328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:40.291466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-02f60749-8bf7-421a-9438-e3dcd7c567bb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.219533 Sep 13 15:30:40.292046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:40 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:41.078167 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:41.079398 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:41.086282 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:41.086891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:41.095408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.095903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.096330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.098415 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.099051 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.099940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.100513 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.101364 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.101974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.102641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.103256 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.108280 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.364199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:41.370024 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:41.378797 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-a31af8cc-c0d3-4cac-b06b-b13604806089 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.304435 Sep 13 15:30:41.380192 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 35/74] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:41 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:41.381821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-595a36dc-ed00-4277-9436-9bd1f1d2f317 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.296359 Sep 13 15:30:41.384650 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 40/75] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:41 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:41.395270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:41.396770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:41.399707 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:41.400059 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:41.408499 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.409178 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.409810 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.410978 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.412500 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.412500 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.422000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.422493 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.423130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.427146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.428241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.429748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.649652 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:41.658027 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:41.659488 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:41.660594 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-03c3fc9f-5f3c-439f-bcc9-025a3388d195 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.279690 Sep 13 15:30:41.661154 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 36/76] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:41 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:41.673590 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-de27285a-190e-4704-a9a6-d34729551426 req-95268071-7ece-4f6c-88e1-e3ead63702c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b86fc1-70f9-4cbe-a998-ec6aef1ba750", "tag": "7f6adc72-52bc-432c-b1c8-d041a0a6fe1b"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:41.675596 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-de27285a-190e-4704-a9a6-d34729551426 req-95268071-7ece-4f6c-88e1-e3ead63702c8 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:41.676070 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-de27285a-190e-4704-a9a6-d34729551426 req-95268071-7ece-4f6c-88e1-e3ead63702c8 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:41.676494 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-de27285a-190e-4704-a9a6-d34729551426 req-95268071-7ece-4f6c-88e1-e3ead63702c8 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:41.688246 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-de27285a-190e-4704-a9a6-d34729551426 req-95268071-7ece-4f6c-88e1-e3ead63702c8 service nova] Creating event network-changed:7f6adc72-52bc-432c-b1c8-d041a0a6fe1b for instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 on hv-cinder-85743 Sep 13 15:30:41.692972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:41.693548 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-de27285a-190e-4704-a9a6-d34729551426 req-95268071-7ece-4f6c-88e1-e3ead63702c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031271 Sep 13 15:30:41.694372 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 37/77] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:41.701647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ab6c2bf1-eba9-49dd-9da2-ba4749062693 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.314914 Sep 13 15:30:41.702407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 41/78] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:41 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:42.402004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=2 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:42.405766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:42.406630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:42.406916 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:42.407580 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:42.413690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.414527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.414917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:42.415773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.416573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.417272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:42.417859 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.418478 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.419124 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:42.419986 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.420638 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.421400 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:42.711762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:42.714449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:42.725700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7af6341e-d1e7-4272-9af4-47736995e380 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.324040 Sep 13 15:30:42.726054 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-2dcfc6b1-496c-42a5-90ed-6f55e466a084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.324921 Sep 13 15:30:42.727208 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 38/79] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:42 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:42.734986 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:42.736156 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:42.739947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 42/80] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:42 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:42.746690 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.747677 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.748547 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:42.749839 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.750879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.751722 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:42.753378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:42.754187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:42.763563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.764222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.764744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:42.765542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:42.766087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:42.766624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:43.174471 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:43.182998 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:43.184452 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:43.185525 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-d54f5cab-f68f-4579-92e6-fe7e00961442 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.457141 Sep 13 15:30:43.186153 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 39/81] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:42 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:43.187192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:43.196213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b4eda66b-8221-4ef1-9306-e6eb557ecd35 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.455014 Sep 13 15:30:43.196786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 43/82] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:42 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:43.749584 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:43.750787 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:43.755058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:43.755664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:43.757356 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:43.757933 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:43.758542 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:43.759437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:43.760235 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:43.761157 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:43.761528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:43.762237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:43.762830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:43.763727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:43.764611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:43.765168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:43.994977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:44.004199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e9c7f06a-497e-4de9-80ec-00b282091428 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.252981 Sep 13 15:30:44.020955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:44.023779 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 44/83] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:43 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:44.025750 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-4ed46edf-966b-488f-8edc-58a55ba7d236 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.280615 Sep 13 15:30:44.026612 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 40/84] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:43 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:44.210527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:44.211201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:44.218476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:44.219329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:44.219673 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:44.220245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:44.220362 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:44.221246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:44.222347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:44.222949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:44.229218 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:44.229716 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:44.230176 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:44.230888 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:44.231342 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:44.235774 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:44.465147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:44.734004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:44.739239 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:44.751054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:44.754489 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:44.757668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8a7ec371-9565-4bcd-aa67-72772a5b5579 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.549401 Sep 13 15:30:44.761296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 45/85] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:44 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:44.803609 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:44.817396 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f833d3cd-1833-4422-8955-4887dd350751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.600770 Sep 13 15:30:44.818091 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 41/86] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:44 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:45.038664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:45.039556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:45.050395 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:45.051349 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:45.073182 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.073672 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.074125 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:45.075905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.076388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.076806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:45.082761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.084233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.084777 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.085265 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.085618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:45.085730 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:45.384320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:45.398221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-737897ba-25e5-420a-970f-1bb57231b075 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.373626 Sep 13 15:30:45.399133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 46/87] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:45 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:45.421549 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:45.430359 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-124b5f8a-9e04-43e0-a542-44994bdce416 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.385551 Sep 13 15:30:45.431486 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:45 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:45.788834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:45.789483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:45.797191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.797683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.800394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:45.801029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.801597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.802041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:45.841055 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:45.841798 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:45.851579 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.852073 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.852493 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:45.856732 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:45.857387 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:45.858923 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:46.115212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:46.130486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:46.131924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:46.133642 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cfd66398-1d2b-43b4-b972-5fd1a4b817b0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.349134 Sep 13 15:30:46.147862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 47/89] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:45 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:46.161984 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:46.171451 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-531d1372-0eea-4503-8379-2002bb5a370e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.334834 Sep 13 15:30:46.180431 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 43/90] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:45 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:46.421378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:46.421987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:46.429424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:46.430452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:46.430919 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:46.432895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:46.433364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:46.433791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:46.453305 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:46.453905 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:46.461114 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:46.464037 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:46.465682 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:46.467286 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:46.468313 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:46.469559 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:46.671540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:46.684561 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0063dcee-fc53-4183-866e-926065ba6a5c tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.266757 Sep 13 15:30:46.688086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 48/91] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:46 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:46.714634 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:46.719197 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:46.727724 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-1d94eedf-063e-4bec-aaf4-ecaef202439b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.278334 Sep 13 15:30:46.728648 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 44/92] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:46 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:47.160567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:47.161924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:47.168929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.169890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.170553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:47.171462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.172186 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.172923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:47.195319 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:47.196769 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:47.211905 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.214644 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.215628 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:47.218080 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.218777 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.224472 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:47.704386 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:47.715334 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-2e82ebe3-3bb5-43a4-b51d-4f0c93817b14 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.524270 Sep 13 15:30:47.734749 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 45/93] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:47 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:47.740436 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:47.741305 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:47.750165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.750886 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.751645 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:47.752466 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.753143 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.753621 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:47.764880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:47.785684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:47.787592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:47.789015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-beda520f-5cd1-4842-8b68-706f6252b31d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.632540 Sep 13 15:30:47.797438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 49/94] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:47 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:47.801212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:47.801826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:47.809226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.809756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.810225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:47.810994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:47.811485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:47.811905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:48.038887 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:48.048471 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8d70831b-6385-473f-a55e-2d1567dceead tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.312223 Sep 13 15:30:48.049519 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 46/95] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:47 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:48.065104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:48.073873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-532484fd-0c76-4d88-97c7-222f297fe939 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.282767 Sep 13 15:30:48.074490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 50/96] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:47 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:48.742283 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:48.742904 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:48.756703 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:48.757215 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:48.757639 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:48.762323 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:48.765691 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:48.766366 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:48.819286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:48.820159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:48.837789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:48.837789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:48.838351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:48.840299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:48.841209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:48.843533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:49.308866 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:49.317347 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-2fc62ee7-2816-4f12-815b-bbf6adf36b30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.581017 Sep 13 15:30:49.321879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 47/97] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:48 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:49.326718 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:49.327303 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:49.346218 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:49.346730 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:49.347473 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:49.348172 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:49.348686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:49.349103 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:49.349904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:49.364935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:49.374372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:49.375801 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ba8061d7-7055-4236-a9b4-50b73e720197 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.562001 Sep 13 15:30:49.377075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 51/98] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:48 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:30:49.383516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:49.384549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:49.392922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:49.394087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:49.394770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:49.405347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:49.408255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:49.412020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:49.700544 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:49.709084 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-bd36ea25-0060-45b1-ad36-666e2c5bf1ba tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.385965 Sep 13 15:30:49.709648 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:49 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:49.726896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:49.735040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ade6e86b-b872-407e-9ae6-31c5103f76bb tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.356775 Sep 13 15:30:49.735613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 52/100] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:49 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:49.835319 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-a37fae0b-060e-425c-afe1-4f710058c3d4 req-6232ac31-3f48-40fb-85ca-72d12687d09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05da62b3-a8ec-4148-b17b-2c08f0e0d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "8c605c1b-be6e-4bf8-8d00-af61d57887b0"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:49.845525 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-a37fae0b-060e-425c-afe1-4f710058c3d4 req-6232ac31-3f48-40fb-85ca-72d12687d09e service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:49.845989 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-a37fae0b-060e-425c-afe1-4f710058c3d4 req-6232ac31-3f48-40fb-85ca-72d12687d09e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:49.846437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-a37fae0b-060e-425c-afe1-4f710058c3d4 req-6232ac31-3f48-40fb-85ca-72d12687d09e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:49.858015 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-a37fae0b-060e-425c-afe1-4f710058c3d4 req-6232ac31-3f48-40fb-85ca-72d12687d09e service nova] Creating event network-vif-plugged:8c605c1b-be6e-4bf8-8d00-af61d57887b0 for instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae on hv-cinder-85743 Sep 13 15:30:49.863233 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-a37fae0b-060e-425c-afe1-4f710058c3d4 req-6232ac31-3f48-40fb-85ca-72d12687d09e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152430 Sep 13 15:30:49.863801 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 49/101] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:50.344476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:50.345299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:50.351920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.352470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.352960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.353947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.354356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.354771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.405704 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:50.406923 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:50.413191 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.413677 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.414473 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.414937 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.415398 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.415852 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.537996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:50.548090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0dd03312-a8b0-4f83-bb25-8b3ab9b8c4ce tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.207178 Sep 13 15:30:50.564842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 53/102] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:50 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:50.581993 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:50.591142 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:50.593261 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:50.594422 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3088b494-5f2d-4b4f-a7e1-6afcdc9076b7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.193146 Sep 13 15:30:50.595047 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 50/103] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:50 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:50.732785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:50.733394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:50.740165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.740721 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.741174 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.741850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.742341 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.742766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.758679 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:50.759275 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:50.765438 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.765911 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.766368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.767044 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:50.767481 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:50.767894 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:50.954071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:50.962242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-86a0e0e9-1af3-4241-910d-ee2bd297ea84 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.233646 Sep 13 15:30:50.962977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 54/104] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:50 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:50.964146 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:50.972870 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-d15111e6-00e3-4178-a936-3b8f7e87c84c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.217968 Sep 13 15:30:50.973402 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 51/105] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:50 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:51.572896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:51.573506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:51.579967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:51.580455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:51.580886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:51.581549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:51.582033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:51.582486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:51.620922 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:51.621516 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:51.628201 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:51.628689 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:51.629115 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:51.629810 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:51.630287 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:51.630705 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:51.775825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:51.783541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-20cacbda-136b-4160-9995-b7bc59981313 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.214727 Sep 13 15:30:51.784188 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 55/106] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:51 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:51.801862 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:51.810565 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:51.811985 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:51.813074 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-96b83fa3-bdb9-43ec-9c4d-71013ddbfec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.196085 Sep 13 15:30:51.813632 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 52/107] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:51 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:51.990138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:51.991131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:51.998128 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:51.998624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:51.998919 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:51.999064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:51.999393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:52.000076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:52.000494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:52.000911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:52.006334 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:52.006817 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:52.007248 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:52.007938 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:52.008435 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:52.008796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:52.191596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:52.195092 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:52.199927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-481ce09c-b7ca-4d01-80f7-2bfa8caed4da tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.216305 Sep 13 15:30:52.200532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:51 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:52.203355 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3f4f63d6-34b1-4a03-b7bb-95f023d7cb5a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.209983 Sep 13 15:30:52.203888 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 53/109] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:51 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:52.822472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:52.822472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:52.822472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:52.822472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:52.823340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:52.823340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:52.823340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:52.823340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:52.839253 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:52.839962 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:52.848541 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:52.849322 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:52.850001 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:52.851131 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:52.851923 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:52.852684 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:53.045920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:53.050667 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:53.055712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-36693dbc-7f84-47d5-9c8a-ca63b69d17b8 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.251989 Sep 13 15:30:53.056294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:52 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:53.060611 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:53.062804 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:53.064462 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-4c14eace-1912-4e16-aac5-d6405937a5a9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.229289 Sep 13 15:30:53.065220 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 54/111] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:52 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:53.223982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:53.224616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:53.228018 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:53.228706 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:53.231180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:53.231659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:53.232080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:53.232775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:53.233216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:53.233718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:53.234904 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:53.235393 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:53.235828 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:53.236514 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:53.236965 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:53.237376 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:53.439617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:53.443489 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:53.448466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a30bc338-f502-4302-9883-953d34fd4800 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.228771 Sep 13 15:30:53.449333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 58/112] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:53 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:53.452481 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-bfd5b5fb-c120-4c68-98be-0cf51f7625d6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.228249 Sep 13 15:30:53.453043 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:53 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:54.085037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:54.085653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:54.092180 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:54.092613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.092704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.093129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.093625 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:54.094918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.095943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.097635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.103326 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.103812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.104681 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.105390 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.105833 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.106407 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.299336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:54.307734 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7536ab77-1a5f-4608-858c-cdbcf2422751 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.228388 Sep 13 15:30:54.308404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 59/114] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:54 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:54.310735 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:54.319383 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:54.321131 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:54.322576 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-702b112a-5aa8-4f0b-9ac9-8c6e18d79179 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.235433 Sep 13 15:30:54.323681 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 56/115] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:54 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:54.473298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:54.474005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:54.476815 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:54.477537 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:54.481536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.482180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.482652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.483377 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.483841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.484343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.485234 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.485737 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.486277 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.487690 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:54.488097 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:54.488512 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:54.677881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:54.681249 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:54.685904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dd766cb8-707d-4c1f-9860-d9782ecb7686 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.217356 Sep 13 15:30:54.686585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 60/116] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:54 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:54.689247 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-535f7197-09a2-477f-aaee-d8573da02643 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.217459 Sep 13 15:30:54.689976 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 57/117] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:54 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:55.149158 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-800700040", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "networks": [{"uuid": "305345df-68fe-42b0-9cf7-d911787f4fba"}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:55.233722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] validate_networks() for [('305345df-68fe-42b0-9cf7-d911787f4fba', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:30:55.341332 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:55.342835 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:55.353692 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.356182 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.357833 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.360198 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.360754 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.361779 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.635904 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:55.644911 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-2313879c-b7b2-4c4d-ad6f-009204fc8218 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.309215 Sep 13 15:30:55.645563 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 58/118] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:55 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:55.650558 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:55.651641 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:55.663728 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.664305 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.664832 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.665604 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.666555 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.667085 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.842426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:30:55.843216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:30:55.843952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:30:55.845271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:30:55.845950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:30:55.862387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.863184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.864175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.865692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.866399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.867775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.874173 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:55.885868 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:55.891811 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:55.893739 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-6ffa83ec-1ed7-44c8-b449-1950c062ac47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.246911 Sep 13 15:30:55.897402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Getting quotas for project 5b820ea465db4802aaa22dbaa4e7397a. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:30:55.902619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Getting quotas for user 5ae72d51e9004670a50362d1206fab21 and project 5b820ea465db4802aaa22dbaa4e7397a. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:30:55.907374 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 59/119] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:55 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:55.914953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:30:55.917914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:30:55.925671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-3c2a25e2-79eb-408d-ac61-aad1f504e035 req-11b6ad59-5e6d-4b51-a264-156e19809ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ef7238-7280-4c0f-b213-4efdc33bccc0", "name": "network-vif-plugged", "status": "completed", "tag": "791fe666-c2cb-4d8a-91fa-3927d141b45c"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:55.936299 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-3c2a25e2-79eb-408d-ac61-aad1f504e035 req-11b6ad59-5e6d-4b51-a264-156e19809ae8 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.936780 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-3c2a25e2-79eb-408d-ac61-aad1f504e035 req-11b6ad59-5e6d-4b51-a264-156e19809ae8 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.937521 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-3c2a25e2-79eb-408d-ac61-aad1f504e035 req-11b6ad59-5e6d-4b51-a264-156e19809ae8 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.949729 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-3c2a25e2-79eb-408d-ac61-aad1f504e035 req-11b6ad59-5e6d-4b51-a264-156e19809ae8 service nova] Creating event network-vif-plugged:791fe666-c2cb-4d8a-91fa-3927d141b45c for instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 on hv-cinder-85743 Sep 13 15:30:55.959811 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-3c2a25e2-79eb-408d-ac61-aad1f504e035 req-11b6ad59-5e6d-4b51-a264-156e19809ae8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049885 Sep 13 15:30:55.960406 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 60/120] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:55.965792 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:55.966572 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:55.973061 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.973534 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.973980 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.974680 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.975123 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.975537 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.980848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-01936dd5-6a00-4616-877c-50349b47f590 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836442 Sep 13 15:30:55.981730 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 61/121] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:30:55.987263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:55.988523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:55.995621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.996183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.996670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:55.997375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:55.997936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:55.998462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:56.297251 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:56.305052 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f18f2dc6-197f-4ca5-98d6-8828bfc537c3 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.343496 Sep 13 15:30:56.305609 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 61/122] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:55 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:56.317419 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-505e6b55-842c-46f1-8082-9d35f3da9da6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:56.322938 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-505e6b55-842c-46f1-8082-9d35f3da9da6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:56.368565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:56.376970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-742c3aeb-a514-407a-9425-01f4dcd88821 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.393773 Sep 13 15:30:56.378614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 62/123] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:55 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:56.432125 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-505e6b55-842c-46f1-8082-9d35f3da9da6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:56.444145 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-505e6b55-842c-46f1-8082-9d35f3da9da6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1213 microversion: 2.1 time: 0.134431 Sep 13 15:30:56.444701 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 62/124] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:56 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:56.672018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:56.672472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:56.685717 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:56.688716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:56.689173 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:56.689890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:56.691026 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:56.691462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:56.726296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:56.889506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:56.899877 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d914bae-9502-4fe7-a18a-7da1de787fbc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.233633 Sep 13 15:30:56.902180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 63/125] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:56 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:56.930377 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:56.930999 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:56.938561 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:56.939253 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:56.939855 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:56.940988 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:56.941754 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:56.942516 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.131066 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:57.136340 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:57.145308 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:57.147380 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:57.148769 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-0ab019ff-c0da-4b2c-8cdb-263f7d598326 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.222768 Sep 13 15:30:57.150889 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 63/126] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:56 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:57.331665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:57.332277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:57.341492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.341977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.342621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.343344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.344165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.344763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.402827 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:57.403790 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:57.411450 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.412379 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.413492 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.414475 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.415412 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.416330 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.542692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:57.551366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cf1455eb-e4ba-4564-8c02-84fd4764271a tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.225927 Sep 13 15:30:57.552067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 64/127] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:57 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:57.556796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:57.557400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:57.563511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.564296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.565395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.566340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.567016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.567547 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.608791 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:57.618083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b5e104a0-3e84-4131-b437-529a952cd871 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.219243 Sep 13 15:30:57.618940 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 64/128] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:57 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:57.648451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:57.656008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-70ca72bb-1735-47ae-9267-1c3bf4c675ea tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1217 microversion: 2.1 time: 0.102819 Sep 13 15:30:57.656799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 65/129] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:57 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:57.923833 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:57.924589 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:57.932010 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.932633 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.933149 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.934123 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:57.934766 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:57.935287 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:57.980933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-66943ddc-2362-406c-ae22-f1a9f7d44290 req-149cf7d4-593b-4fd9-9760-6c68ba8f093e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3f4ab8-cedc-4b59-a85c-89535bb22caf", "name": "network-vif-plugged", "status": "completed", "tag": "cdd622f7-1540-4df3-9a58-fc9530ecac1d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:30:58.005225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-66943ddc-2362-406c-ae22-f1a9f7d44290 req-149cf7d4-593b-4fd9-9760-6c68ba8f093e service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.005788 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-66943ddc-2362-406c-ae22-f1a9f7d44290 req-149cf7d4-593b-4fd9-9760-6c68ba8f093e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.006348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-66943ddc-2362-406c-ae22-f1a9f7d44290 req-149cf7d4-593b-4fd9-9760-6c68ba8f093e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.023321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-66943ddc-2362-406c-ae22-f1a9f7d44290 req-149cf7d4-593b-4fd9-9760-6c68ba8f093e service nova] Creating event network-vif-plugged:cdd622f7-1540-4df3-9a58-fc9530ecac1d for instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf on hv-cinder-85743 Sep 13 15:30:58.030392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-66943ddc-2362-406c-ae22-f1a9f7d44290 req-149cf7d4-593b-4fd9-9760-6c68ba8f093e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054766 Sep 13 15:30:58.031793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 66/130] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:30:58.117128 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:58.126729 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-653d450a-af8c-45d1-81c3-c6ffdd158fa3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.206943 Sep 13 15:30:58.127301 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 65/131] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:57 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:58.175948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:58.176866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:58.183622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.184340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.185496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.186409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.187187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.187780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.346015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:58.359483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:58.361146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:58.362711 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f2ab0a91-dba2-49ab-a848-899a848c176c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.191755 Sep 13 15:30:58.363818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 67/132] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:58 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:58.574724 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:58.575320 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:58.584098 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.584711 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.585268 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.596436 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.597269 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.597735 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.641233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:58.641973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:58.644443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:30:58.650648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.651337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.651876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.652751 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.653291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.653894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.874426 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:58.884904 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-c3fd9aab-a278-44b9-a973-67d9acc79aee tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.314263 Sep 13 15:30:58.885532 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 66/133] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:58 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:58.905476 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:58.906076 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:58.908739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:58.917214 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.917814 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.918432 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.919310 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:58.919994 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:58.920408 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:58.920506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e41fc54a-05f3-41b5-a290-804bd55358c1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.283006 Sep 13 15:30:58.922385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 68/134] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:58 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:30:59.011264 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:59.021227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-edb621ed-90e7-4037-9a4b-93f815d1ec33 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1217 microversion: 2.1 time: 0.130364 Sep 13 15:30:59.027292 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:58 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:59.149618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:59.150521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:59.161373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.162059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.162659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:59.174756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.175400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.176005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:59.389065 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:59.389912 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:59.408083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.408948 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.411303 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:59.412203 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.413863 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.414471 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:59.682840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:59.706998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-00575cd6-1135-4535-a607-dddf9b2ecc88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.561145 Sep 13 15:30:59.711815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:59 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:30:59.883127 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:59.911100 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:59.915434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:59.916794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:59.916970 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:30:59.918606 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f7873438-5153-4568-859d-a05f93bc58d1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.533607 Sep 13 15:30:59.921318 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 68/137] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:30:59 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:30:59.932169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.932663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.933168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:59.934757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.935439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.936581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:59.950426 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:30:59.951047 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:30:59.966319 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.988481 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.989580 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:30:59.991726 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:30:59.992900 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:30:59.993475 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.477582 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:00.488866 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3e0bc2dc-3fd5-4db5-8690-f9d4579bce59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.541716 Sep 13 15:31:00.489379 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 69/138] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:59 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:00.498831 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:00.502731 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:00.516046 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:00.518015 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:00.518620 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.520231 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:00.521641 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:00.524903 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.549475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:00.559423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8dedc3d9-202f-440a-bc0d-1577cc698516 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.653488 Sep 13 15:31:00.568636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 70/139] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:30:59 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:00.587861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-084cf5b8-f6ce-4aa9-a0f8-2889acce1b47 req-f6681250-3be0-4550-abd2-09d327d923a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecad0016-167e-481d-bc1a-44f01c614a59", "name": "network-vif-plugged", "status": "completed", "tag": "678a26e2-4972-4820-8b36-e8ab2402f95d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:00.614732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-084cf5b8-f6ce-4aa9-a0f8-2889acce1b47 req-f6681250-3be0-4550-abd2-09d327d923a0 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:00.620556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-084cf5b8-f6ce-4aa9-a0f8-2889acce1b47 req-f6681250-3be0-4550-abd2-09d327d923a0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:00.621090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-084cf5b8-f6ce-4aa9-a0f8-2889acce1b47 req-f6681250-3be0-4550-abd2-09d327d923a0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.648129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-084cf5b8-f6ce-4aa9-a0f8-2889acce1b47 req-f6681250-3be0-4550-abd2-09d327d923a0 service nova] Creating event network-vif-plugged:678a26e2-4972-4820-8b36-e8ab2402f95d for instance ecad0016-167e-481d-bc1a-44f01c614a59 on hv-cinder-85743 Sep 13 15:31:00.657707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-084cf5b8-f6ce-4aa9-a0f8-2889acce1b47 req-f6681250-3be0-4550-abd2-09d327d923a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073433 Sep 13 15:31:00.657841 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:00.660047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 71/140] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:00.667387 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9761bb0c-875f-44a4-9fa2-13dea6957d0f tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1209 microversion: 2.1 time: 0.176614 Sep 13 15:31:00.669023 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 70/141] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:00 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1209 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:00.739226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:00.739924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:00.747062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:00.747963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:00.748586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.749487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:00.750159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:00.750754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.949286 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:00.949895 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:00.956944 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:00.957395 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:00.957970 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.959143 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:00.959746 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:00.960313 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:00.962415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:00.977134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-624d9d98-59b6-4dcc-abde-d341cd08df32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1362 microversion: 2.1 time: 0.242346 Sep 13 15:31:00.982817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 72/142] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:00 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:01.125499 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:01.134518 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:01.142182 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:01.143480 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-e51cd140-ce11-412e-b799-bc104711bbce tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.198605 Sep 13 15:31:01.144239 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 71/143] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:31:00 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:31:01.513623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:01.514466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:01.520495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:01.530882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:01.531336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:01.532079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:01.532583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:01.533006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:01.591844 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:01.592357 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:01.599876 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:01.609802 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:01.614749 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:01.615680 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:01.617991 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:01.618642 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:01.949433 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:01.955759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:01.964882 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-11060a5e-f59d-4f87-aa29-d9f2074a7f36 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.377232 Sep 13 15:31:01.965952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 72/144] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:01 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:01.970832 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:01.972848 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:01.974453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8cf123e8-3a86-49de-9e65-3427f72d9b04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1321 microversion: 2.1 time: 0.465028 Sep 13 15:31:01.979454 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:01.980132 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:01.980268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 73/145] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:01 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:01.980832 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:01.981656 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:01.982279 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:01.983131 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.000438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:02.001121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:02.009792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.010811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:02.011449 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.012631 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.013254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:02.013841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.085212 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:02.099260 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-811b78d4-6fc3-4584-94eb-e826c007bedd tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1209 microversion: 2.1 time: 0.131890 Sep 13 15:31:02.100589 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 73/146] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:01 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:02.172746 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:02.173600 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:02.181404 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_api:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:02.183733 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.184555 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:02.185195 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.186545 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.187307 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:02.188114 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.225542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:02.234412 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d1bef1ee-e067-4934-a515-330115843862 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1547 microversion: 2.1 time: 0.237802 Sep 13 15:31:02.235836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 74/147] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:01 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:02.270286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:02.271075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:02.280805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.281521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:02.282164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.283359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.284008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:02.284434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.518755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-12f7b6c4-fd28-491a-b5f8-681b3fd39dac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.254516 Sep 13 15:31:02.519878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:31:02 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:31:02.539949 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:02.562298 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:02.565796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:02.566988 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-4afeffa8-c17b-4884-beb6-32d890bb7ddd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.398576 Sep 13 15:31:02.571915 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 74/149] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:31:02 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:31:02.674531 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-435389e0-be21-44e7-a5df-b65a8ae4777d req-05dc9f94-869a-4245-8306-ce6488fc51b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b86fc1-70f9-4cbe-a998-ec6aef1ba750", "name": "network-vif-plugged", "status": "completed", "tag": "7f6adc72-52bc-432c-b1c8-d041a0a6fe1b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:02.688903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-435389e0-be21-44e7-a5df-b65a8ae4777d req-05dc9f94-869a-4245-8306-ce6488fc51b3 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.690054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-435389e0-be21-44e7-a5df-b65a8ae4777d req-05dc9f94-869a-4245-8306-ce6488fc51b3 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:02.690654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-435389e0-be21-44e7-a5df-b65a8ae4777d req-05dc9f94-869a-4245-8306-ce6488fc51b3 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:02.704280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-435389e0-be21-44e7-a5df-b65a8ae4777d req-05dc9f94-869a-4245-8306-ce6488fc51b3 service nova] Creating event network-vif-plugged:7f6adc72-52bc-432c-b1c8-d041a0a6fe1b for instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 on hv-cinder-85743 Sep 13 15:31:02.710209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-435389e0-be21-44e7-a5df-b65a8ae4777d req-05dc9f94-869a-4245-8306-ce6488fc51b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040119 Sep 13 15:31:02.710969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 76/150] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:02.989542 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:02.990165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:02.997970 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:02.998838 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.000750 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.003253 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.003925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:03.005310 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.005760 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.006959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:03.018033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.019129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.020065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.021007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.021680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.023540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.366729 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:03.375413 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-103565a6-f4b1-4fee-a6c5-34c7905ddbed tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1314 microversion: 2.1 time: 0.390000 Sep 13 15:31:03.375995 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:02 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:03.403323 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:03.412777 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:03.427896 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.428815 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.429664 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.430450 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.430905 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.433548 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.486828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:03.502001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f208dca-9733-4bbe-b2f8-10dbb6f24d77 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1515 microversion: 2.1 time: 0.507086 Sep 13 15:31:03.515125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 77/152] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:02 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1515 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:03.530550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:03.533069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:03.539618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.540460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.541592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.542560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.543223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.543850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.572496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lazy-loading 'flavor' on Instance uuid 29ef7238-7280-4c0f-b213-4efdc33bccc0 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:31:03.653793 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:03.670306 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-79aa6aa5-db62-4666-8460-1e9d2a41a197 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1209 microversion: 2.1 time: 0.268352 Sep 13 15:31:03.670947 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:03 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1209 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:03.685967 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:03.690892 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:03.699535 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.700200 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.700787 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.701664 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.702430 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.703012 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.789175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5a5016a0-3326-4194-85b7-fd25f618d630 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0/action" status: 200 len: 32 microversion: 2.1 time: 0.263051 Sep 13 15:31:03.795443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 78/154] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:31:03 2022] POST /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:31:03.801138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:03.801835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:03.810626 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.811491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.812117 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:03.813115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:03.813963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:03.814732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:04.103833 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:04.119493 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:04.121105 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:04.124687 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f309014a-8559-42ee-9b98-ba7d218bf95b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.449710 Sep 13 15:31:04.140842 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 77/155] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:31:03 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:31:04.157060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:04.179214 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4b0af0cc-0570-49fc-98a6-e49aa00c88a1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.382566 Sep 13 15:31:04.180625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:03 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:04.404428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:04.406376 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:04.416272 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:04.417028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:04.417998 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:04.419302 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:04.419912 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:04.420893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:04.693508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:04.694519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:04.707351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:04.708158 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:04.708752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:04.710363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:04.711329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:04.711916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:04.725007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:04.770616 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:04.783677 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-6cbc19e6-3e4e-460c-a52d-37c9e12df85f tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1500 microversion: 2.1 time: 0.387372 Sep 13 15:31:04.784896 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:04 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1500 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:04.789906 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-4d60e66b-dc67-4c33-b4c4-7eb869f5c1ec req-3dedad4d-28cf-4c46-9713-69635442b1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05da62b3-a8ec-4148-b17b-2c08f0e0d2ae", "tag": "8c605c1b-be6e-4bf8-8d00-af61d57887b0"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:04.803239 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-4d60e66b-dc67-4c33-b4c4-7eb869f5c1ec req-3dedad4d-28cf-4c46-9713-69635442b1b1 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:04.804246 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-4d60e66b-dc67-4c33-b4c4-7eb869f5c1ec req-3dedad4d-28cf-4c46-9713-69635442b1b1 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:04.805212 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-4d60e66b-dc67-4c33-b4c4-7eb869f5c1ec req-3dedad4d-28cf-4c46-9713-69635442b1b1 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:04.829211 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-4d60e66b-dc67-4c33-b4c4-7eb869f5c1ec req-3dedad4d-28cf-4c46-9713-69635442b1b1 service nova] Creating event network-changed:8c605c1b-be6e-4bf8-8d00-af61d57887b0 for instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae on hv-cinder-85743 Sep 13 15:31:04.838435 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-4d60e66b-dc67-4c33-b4c4-7eb869f5c1ec req-3dedad4d-28cf-4c46-9713-69635442b1b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050637 Sep 13 15:31:04.839953 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 79/158] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:04.881970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:04.899709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5ecb8978-ffcd-4570-a031-e32baf09f110 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1265 microversion: 2.1 time: 0.208800 Sep 13 15:31:04.902377 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 80/159] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:04 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:05.155181 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:05.155897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:05.167094 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:05.167853 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:05.168901 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:05.170350 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:05.172258 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:05.173291 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:05.206389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:05.207175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:05.232179 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:05.234142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:05.236479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:05.239418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:05.245831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:05.248491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:05.686437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:05.697819 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:05.702165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:05.704326 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-26530143-1675-4cb4-98d3-f2b4796bd9ea tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.550983 Sep 13 15:31:05.704925 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 80/160] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:31:05 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:31:05.739401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:05.750047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-310b20a8-cce2-489c-b853-fb11dc544ef1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.549206 Sep 13 15:31:05.763437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 81/161] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:05 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:05.933727 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:05.934553 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:05.940878 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:05.941337 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:05.941749 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:05.942478 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:05.942922 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:05.943352 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:05.948218 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:06.045861 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:06.061890 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-c7fb95ab-2676-4c5a-991c-5b78e291797a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1265 microversion: 2.1 time: 0.129850 Sep 13 15:31:06.063313 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 81/162] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:05 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:06.513360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7bb2faa-ef64-438b-8126-d383d9d9f4c3"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:06.521094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:06.524243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:06.527630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:06.545674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:06.553281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:06.554725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:06.555598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:06.556417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:06.558652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:06.730694 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:06.731250 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:06.743455 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=2 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:06.745510 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:06.746001 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:06.746535 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:06.759193 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:06.760379 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:06.763144 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:06.977178 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:06.987432 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:06.989159 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:06.990408 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-d73df25c-188f-4e89-819f-1d9c550879b4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1407 microversion: 2.20 time: 0.265262 Sep 13 15:31:07.003337 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 82/163] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:31:06 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:31:07.003337 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:07.003337 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:07.003934 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:07.004639 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:07.011040 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:07.011040 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:07.011040 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:07.011040 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:07.164604 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:07.172941 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-35700c8e-0dc3-4fe5-b392-ce8f756d9dd9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.180353 Sep 13 15:31:07.173583 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:06 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:07.183059 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:07.183666 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:07.190143 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:07.190625 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:07.191103 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:07.191801 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:07.192224 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:07.192758 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:07.257489 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:07.265380 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-5cecf8b4-17af-4682-8241-7b528294c4c6 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1265 microversion: 2.1 time: 0.090653 Sep 13 15:31:07.265980 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 84/165] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:07 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:08.019268 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:08.020778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:08.033243 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.037470 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.039441 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.044651 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.048762 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.049694 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.182579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-56e96f2b-1813-4229-8bc9-42b9ce79ffd4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "POST /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.676939 Sep 13 15:31:08.183910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 82/166] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:31:06 2022] POST /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf/os-volume_attachments => generated 194 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:08.196270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:08.197304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:08.208835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.209005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.209733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.210661 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.211266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.218510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.714173 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:08.723202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:08.723842 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:08.725283 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:08.728585 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-a451e334-cedf-4985-b257-e13e4410715f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1599 microversion: 2.20 time: 0.713278 Sep 13 15:31:08.731533 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 85/167] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:31:08 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1599 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:31:08.742996 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:08.744157 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:08.751636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c3880b0b-4b75-4b45-a7ea-1542b58f6559 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.556425 Sep 13 15:31:08.754522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 83/168] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:08 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:08.759300 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.761893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.763391 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.765552 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.766415 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.768344 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.776267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:08.777321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:08.784177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.786045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.786778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.787935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:08.788741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:08.790465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:08.900269 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:08.915105 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9384d822-0a99-45f7-832f-66c2d31cb8e1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1271 microversion: 2.1 time: 0.182003 Sep 13 15:31:08.916635 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 86/169] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:08 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:08.957041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-93e968ae-c5f2-438d-b4c4-3809a3cc4689 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.189065 Sep 13 15:31:08.957812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 84/170] 10.222.0.16 () {60 vars in 1316 bytes} [Tue Sep 13 15:31:08 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:31:09.785059 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:09.785670 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:09.792177 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:09.792661 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:09.793081 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:09.793774 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:09.794257 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:09.794673 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:09.934137 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:09.942399 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-436d0297-10a3-49d5-b389-a694818da331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.165792 Sep 13 15:31:09.942861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:09.943342 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:09 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:09.943623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:09.950295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:09.950870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:09.951391 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:09.952160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:09.952680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:09.953511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:10.050320 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-35e66f91-c97f-48cc-b5e4-e40792857a90 req-f6300146-0dfc-473f-a381-fc1c35121a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b86fc1-70f9-4cbe-a998-ec6aef1ba750", "tag": "7f6adc72-52bc-432c-b1c8-d041a0a6fe1b"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:10.060264 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-35e66f91-c97f-48cc-b5e4-e40792857a90 req-f6300146-0dfc-473f-a381-fc1c35121a65 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:10.060737 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-35e66f91-c97f-48cc-b5e4-e40792857a90 req-f6300146-0dfc-473f-a381-fc1c35121a65 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:10.061373 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-35e66f91-c97f-48cc-b5e4-e40792857a90 req-f6300146-0dfc-473f-a381-fc1c35121a65 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:10.073280 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-35e66f91-c97f-48cc-b5e4-e40792857a90 req-f6300146-0dfc-473f-a381-fc1c35121a65 service nova] Creating event network-changed:7f6adc72-52bc-432c-b1c8-d041a0a6fe1b for instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 on hv-cinder-85743 Sep 13 15:31:10.078687 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-35e66f91-c97f-48cc-b5e4-e40792857a90 req-f6300146-0dfc-473f-a381-fc1c35121a65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031942 Sep 13 15:31:10.079516 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 88/172] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:31:10.108770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:10.116526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c84f6158-cb76-4ade-b7cb-95856f4272f4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.178971 Sep 13 15:31:10.117090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 85/173] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:09 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:10.967378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:10.968074 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:10.975294 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:10.975771 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:10.976196 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:10.976884 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:10.977330 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:10.978080 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:11.120168 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:11.127942 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-1e49afb3-4db5-42ae-a0e7-113b8f2f377e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.166229 Sep 13 15:31:11.128519 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 89/174] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:10 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:11.144199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:11.145258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:11.156286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:11.156778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:11.157207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:11.158663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:11.159229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:11.160335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:11.302490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:11.310865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a9d6a37d-67d4-4361-8785-10d9a70dd24e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.173876 Sep 13 15:31:11.311446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 86/175] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:11 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:12.154551 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:12.155199 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:12.163542 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:12.164105 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:12.164608 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:12.165536 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:12.166147 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:12.166703 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:12.300173 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:12.307987 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-284d69ca-1587-452d-8c8c-f963a4b96331 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.158957 Sep 13 15:31:12.308556 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 90/176] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:12 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:12.333163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:12.333878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:12.340800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:12.341301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:12.341698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:12.342466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:12.342918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:12.343333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:12.586506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:12.595269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-07bd2056-5957-4a83-b2b6-45daa14f89fe tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.266249 Sep 13 15:31:12.595818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 87/177] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:12 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:13.064499 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-0eb8b8bc-7305-4c4e-8fa4-ea2952489ba1 req-94b07e73-aa0a-466b-bf6e-0e3faf9d23a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209db596-6cc6-4312-8e98-1327446778fc", "tag": "ca686017-271b-4552-bbca-3525460062b2"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:13.077552 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-0eb8b8bc-7305-4c4e-8fa4-ea2952489ba1 req-94b07e73-aa0a-466b-bf6e-0e3faf9d23a1 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:13.078340 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-0eb8b8bc-7305-4c4e-8fa4-ea2952489ba1 req-94b07e73-aa0a-466b-bf6e-0e3faf9d23a1 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:13.078952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-0eb8b8bc-7305-4c4e-8fa4-ea2952489ba1 req-94b07e73-aa0a-466b-bf6e-0e3faf9d23a1 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:13.092226 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-0eb8b8bc-7305-4c4e-8fa4-ea2952489ba1 req-94b07e73-aa0a-466b-bf6e-0e3faf9d23a1 service nova] Creating event network-changed:ca686017-271b-4552-bbca-3525460062b2 for instance 209db596-6cc6-4312-8e98-1327446778fc on hv-cinder-85743 Sep 13 15:31:13.097793 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-0eb8b8bc-7305-4c4e-8fa4-ea2952489ba1 req-94b07e73-aa0a-466b-bf6e-0e3faf9d23a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038707 Sep 13 15:31:13.098371 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 91/178] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:13.330893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:13.331494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:13.338247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:13.338849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:13.339977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:13.340678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:13.341125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:13.341628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:13.560224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:13.568938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d4812359-048a-4dec-9801-8d223cc53f59 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.241880 Sep 13 15:31:13.569514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 88/179] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:13 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:13.621511 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:13.622446 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:13.631186 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:13.631991 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:13.632523 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:13.633329 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:13.633926 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:13.634541 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:13.774128 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:13.782424 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-325dd608-097b-43d5-98d0-2b10d3b53879 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.166193 Sep 13 15:31:13.782996 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 92/180] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:13 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:14.592409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:14.592948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:14.600766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:14.601256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:14.601713 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:14.602607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:14.603104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:14.603574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:14.743340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:14.751293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9fa8ab05-8d82-4b70-9068-a8ed65caea4f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.163386 Sep 13 15:31:14.751865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 89/181] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:14 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:14.808864 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:14.809520 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:14.818571 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:14.819285 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:14.819946 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:14.821003 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:14.822157 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:14.822585 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:14.952591 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:14.960390 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-68ab87e1-d04d-432d-bba9-4c1b8af9c76b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.158745 Sep 13 15:31:14.960940 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 93/182] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:14 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:15.775769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:15.776473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:15.782698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:15.783271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:15.783594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:15.784277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:15.784747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:15.785166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:15.916687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:15.924675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cd5ccd3e-9f17-4efb-8497-b1e05f80990e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.153359 Sep 13 15:31:15.925293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 90/183] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:15 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:15.983601 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:15.984279 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:15.990450 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:15.991009 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:15.991498 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:15.992257 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:15.992795 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:15.993391 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:16.129179 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:16.137934 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8694579c-817e-4509-a6b0-f74af1f7210c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.158246 Sep 13 15:31:16.158320 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 94/184] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:15 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:16.948177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:16.948784 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:16.955396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:16.955939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:16.956374 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:16.957071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:16.957523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:16.957945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:17.090869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:17.100539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-319db4bc-098e-4d8d-b10f-61d478a21138 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.156171 Sep 13 15:31:17.101405 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 91/185] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:16 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:17.167820 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:17.168432 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:17.175325 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:17.175904 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:17.176392 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:17.177153 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:17.177663 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:17.178144 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:17.317928 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:17.326220 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-e67873a8-6d20-4fa5-b9f9-72ee957df5f2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.162484 Sep 13 15:31:17.326853 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 95/186] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:17 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:18.124257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:18.124861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:18.131909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:18.132428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:18.132863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:18.133660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:18.134026 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:18.134485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:18.267478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:18.276012 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-58ed8a88-9f3c-4700-9963-dbe4f4f58a8a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.155720 Sep 13 15:31:18.276582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 92/187] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:18 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:18.353942 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:18.354884 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:18.365077 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:18.365890 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:18.366676 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:18.367966 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:18.368410 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:18.368835 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:18.499147 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:18.506975 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-d5671b02-c5be-4fa6-94b2-13bab9f0af4d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.160141 Sep 13 15:31:18.507594 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 96/188] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:18 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:19.303400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:19.304216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:19.315538 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:19.316292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:19.317035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:19.318171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:19.318932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:19.319649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:19.460187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:19.468423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d3bd3a96-63c9-405c-a8a3-37a0c20ecfc7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.171636 Sep 13 15:31:19.469157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 93/189] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:19 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:19.533661 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:19.534554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:19.550184 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:19.550831 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:19.551448 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:19.552475 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:19.553280 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:19.553774 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:19.697230 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:19.708511 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-013b12ca-877d-47e3-8cbd-8c7cd3e69bd7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.180824 Sep 13 15:31:19.709076 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 97/190] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:19 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:20.491789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:20.492384 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:20.499325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:20.499906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:20.500335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:20.501033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:20.501550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:20.502091 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:20.644881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:20.653411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2365d261-3ea5-4c44-870b-e985149c25a4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.165550 Sep 13 15:31:20.654197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 94/191] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:20 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:20.731708 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:20.732941 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:20.738951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:20.739501 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:20.740108 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:20.741010 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:20.741495 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:20.741970 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:20.898955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:20.907113 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-e70e611f-46ee-4f89-a455-d84e2a56b361 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.179232 Sep 13 15:31:20.907689 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 98/192] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:20 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:21.677220 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:21.678504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:21.685652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:21.686161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:21.686594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:21.687439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:21.687890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:21.688307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:21.828261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:21.832075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:21.837130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-83530ad2-12aa-42be-b10d-48663e8da752 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.164112 Sep 13 15:31:21.837990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 95/193] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:21 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:21.929905 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:21.930519 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:21.936547 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:21.937709 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:21.938184 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:21.939083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:21.939695 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:21.940248 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:21.944605 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:22.090402 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:22.099274 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-943fb2a3-d331-44c5-9404-a83ac26b47b0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.173229 Sep 13 15:31:22.099836 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 99/194] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:21 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:22.864062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:22.865457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:22.874088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:22.874587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:22.875033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:22.875885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:22.876314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:22.876925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:23.016322 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:23.025192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f0f4d013-0f2f-4a8e-98bb-d627ae954a06 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.166699 Sep 13 15:31:23.026070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 96/195] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:22 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:23.123333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:23.124162 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:23.130939 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:23.131561 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:23.132062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:23.132820 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:23.133335 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:23.133961 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:23.267507 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:23.275392 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3cb43e08-82af-4f0b-a686-885793f4da99 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.156104 Sep 13 15:31:23.275950 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 100/196] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:23 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:24.059165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:24.059753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:24.066564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:24.067044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:24.067469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:24.068158 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:24.068601 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:24.069014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:24.216560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:24.225638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-add9f1b7-138f-497b-bb77-b6b4f3f4aa9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.170107 Sep 13 15:31:24.230582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 97/197] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:24 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:24.299363 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:24.300748 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:24.307755 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:24.308223 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:24.308652 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:24.309344 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:24.309792 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:24.310238 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:24.379065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-7f49980d-9ce1-4e97-9c8e-7d52d45337b7 req-cd4664a6-ab5e-41e0-a3d3-4d171a2ee3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209db596-6cc6-4312-8e98-1327446778fc", "name": "network-vif-plugged", "status": "completed", "tag": "ca686017-271b-4552-bbca-3525460062b2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:24.389746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7f49980d-9ce1-4e97-9c8e-7d52d45337b7 req-cd4664a6-ab5e-41e0-a3d3-4d171a2ee3f2 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:24.391085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7f49980d-9ce1-4e97-9c8e-7d52d45337b7 req-cd4664a6-ab5e-41e0-a3d3-4d171a2ee3f2 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:24.391839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7f49980d-9ce1-4e97-9c8e-7d52d45337b7 req-cd4664a6-ab5e-41e0-a3d3-4d171a2ee3f2 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:24.410297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-7f49980d-9ce1-4e97-9c8e-7d52d45337b7 req-cd4664a6-ab5e-41e0-a3d3-4d171a2ee3f2 service nova] Creating event network-vif-plugged:ca686017-271b-4552-bbca-3525460062b2 for instance 209db596-6cc6-4312-8e98-1327446778fc on hv-cinder-85743 Sep 13 15:31:24.417808 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-7f49980d-9ce1-4e97-9c8e-7d52d45337b7 req-cd4664a6-ab5e-41e0-a3d3-4d171a2ee3f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042798 Sep 13 15:31:24.418690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 98/198] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:31:24.511392 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:24.520230 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9c6bf9fd-fc20-4e50-a36a-fd8fc029e20a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.225458 Sep 13 15:31:24.521494 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 101/199] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:24 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:25.251757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:25.253045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:25.260166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:25.260647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:25.261146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:25.261845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:25.262859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:25.262966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:25.401180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:25.409195 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c5179fa4-07f0-457a-98e9-1ce9d65a723b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.163742 Sep 13 15:31:25.409749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 99/200] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:25 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:25.544554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:25.549181 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:25.554526 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:25.555014 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:25.555443 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:25.556121 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:25.556585 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:25.557001 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:25.732711 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:25.740962 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3df534a3-e2e0-4b3b-b560-cc7df9dbd3c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.200893 Sep 13 15:31:25.741530 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 102/201] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:25 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:26.433155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:26.433931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:26.441034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:26.441624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:26.442205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:26.443033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:26.443839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:26.444451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:26.579793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:26.588151 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c548a3bd-3580-4835-b08d-e8db3e90b5ea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.159038 Sep 13 15:31:26.588743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 100/202] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:26 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:26.765284 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:26.765983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:26.772438 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:26.773006 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:26.773499 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:26.774296 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:26.774812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:26.775296 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:26.906315 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:26.914075 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-25555416-6bdb-4041-9c39-7dcc19476372 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.152975 Sep 13 15:31:26.914668 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 103/203] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:26 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:27.611568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:27.612248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:27.618904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:27.619414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:27.619836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:27.620524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:27.620968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:27.621382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:27.936795 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:27.937480 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:27.944086 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:27.944692 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:27.945227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:27.946020 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:27.946603 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:27.947114 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:27.951037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:27.960517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e50674e2-05a9-4564-9b7b-b1ade5ce419b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.353080 Sep 13 15:31:27.961291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 101/204] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:27 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:28.128170 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:28.135903 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-4a7b260b-7988-4d06-a721-3e5f5314d6f3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.203027 Sep 13 15:31:28.136679 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 104/205] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:27 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:28.985806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:28.986443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:28.988971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=68 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:28.994297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:28.994838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:28.995290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:28.996071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:28.996522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:28.996978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:29.163487 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:29.163966 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:29.170067 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:29.170758 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:29.171559 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:29.172725 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:29.173340 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:29.174091 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:29.193781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:29.205434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ce1f29f6-a1cc-42b9-a3e0-e0ea2b6bb755 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.224019 Sep 13 15:31:29.206723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 102/206] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:28 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:29.369716 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:29.377637 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-bd07c0b6-cdae-4b92-af9c-f74ffbd8bd13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.218210 Sep 13 15:31:29.379480 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 105/207] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:29 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:29.424733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1009566640", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:29.487450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] validate_networks() for None {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:31:29.815213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:31:29.815629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:31:29.816092 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:31:29.816495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:31:29.816897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:31:29.825663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:29.826171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:29.826603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:29.827322 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:29.827772 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:29.828247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:29.845356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Getting quotas for project c1b581d18eee429cb4415287c1887fa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:31:29.849894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Getting quotas for user 47bc6dff55e847ba93eb7bfdcf4e95b2 and project c1b581d18eee429cb4415287c1887fa7. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:31:29.863945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:31:29.866405 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:31:29.919618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ae9edfee-8f2d-493c-99df-47b5bb6fef4b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500202 Sep 13 15:31:29.920274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 103/208] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:31:29.931634 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-32571ded-d2cc-4ce0-8358-1d6bdcc8ccae tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:29.932632 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-32571ded-d2cc-4ce0-8358-1d6bdcc8ccae tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:29.994824 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-32571ded-d2cc-4ce0-8358-1d6bdcc8ccae tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:30.002999 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-32571ded-d2cc-4ce0-8358-1d6bdcc8ccae tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1215 microversion: 2.1 time: 0.075238 Sep 13 15:31:30.003880 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 106/209] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:29 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:30.230898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:30.231520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:30.243141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:30.243646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:30.244131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:30.244846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:30.246079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:30.246543 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:30.405354 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:30.407367 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:30.416636 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:30.417729 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:30.418366 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:30.419708 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:30.420763 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:30.422048 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:30.605554 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:30.614694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5a80ae85-43e3-4cdc-83b2-c30b2f9ff419 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.389039 Sep 13 15:31:30.615271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 104/210] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:30 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:30.620768 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:30.628208 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-fc63687a-2d83-42e8-95a6-9acc4ddbfbcc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.230010 Sep 13 15:31:30.628857 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 107/211] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:30 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:31.025835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:31.026485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:31.034199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:31.035036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:31.035684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:31.036603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:31.037146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:31.037628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:31.104930 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:31.112924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f34e5a48-d338-4e49-806f-e2cbdc130f88 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1219 microversion: 2.1 time: 0.091061 Sep 13 15:31:31.113461 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 105/212] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:31 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:31.638163 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:31.638683 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:31.645153 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:31.645710 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:31.646418 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:31.647271 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:31.647871 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:31.648524 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:31.651417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:31.652028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:31.659277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:31.660154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:31.660805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:31.662008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:31.662566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:31.663153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:31.903661 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:31.909008 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:31.913633 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-11a2b74d-4076-4fbe-9076-fafb3461c012 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1313 microversion: 2.1 time: 0.266553 Sep 13 15:31:31.914612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 106/213] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:31 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:31.918812 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-36e1fc62-9653-4a64-a013-017f159a433e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.283809 Sep 13 15:31:31.919443 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:31 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:32.137279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:32.137851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:32.165353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.166014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.166456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.167488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.167941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.168335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.248707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:32.256602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d6483f0f-b17f-47cc-ad38-89e4cec1e48a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1267 microversion: 2.1 time: 0.123169 Sep 13 15:31:32.257167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 107/215] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:32 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:32.452819 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:32.453537 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:32.455452 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_api:SELECT=71 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:32.460675 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.461164 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.461600 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.462306 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.462783 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.463203 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.490532 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Going to try to terminate instance {{(pid=120659) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:31:32.625304 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-a3331dbc-2eb5-4e54-a34b-2d1adb28f76d tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 204 len: 0 microversion: 2.1 time: 0.175735 Sep 13 15:31:32.625643 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 109/216] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:31:32 2022] DELETE /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:31:32.633988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:32.634674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:32.640839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.641332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.641766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.642491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.642947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.643370 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.776693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:32.786320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a12011d4-013b-403d-9830-cb86dfad8559 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1552 microversion: 2.1 time: 0.156214 Sep 13 15:31:32.786891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 108/217] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:32 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:32.938935 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:32.940325 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:32.942643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:32.943189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:32.946560 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.947038 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.947461 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.948237 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.948673 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.949090 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.950313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.950776 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.951230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:32.951932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:32.952388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:32.952809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:33.146550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:33.150317 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:33.159675 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-fb519904-22ac-4239-bcd6-6051443e0d8c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1498 microversion: 2.1 time: 0.225084 Sep 13 15:31:33.160462 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 110/218] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:32 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1498 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:33.161011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-75ab9a88-6d50-450e-a0d8-dbcf9ccc9374 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.222235 Sep 13 15:31:33.161581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 109/219] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:32 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:33.279144 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:33.279770 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:33.302719 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:33.303387 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:33.304082 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:33.304851 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:33.305312 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:33.305711 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:33.374522 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:33.383521 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8f663b2b-4830-4002-9553-c45cbd404373 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1267 microversion: 2.1 time: 0.108578 Sep 13 15:31:33.384161 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 111/220] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:33 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:33.811157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:33.811768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:33.818638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:33.819126 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:33.819563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:33.820283 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:33.820731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:33.821161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:33.960771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:33.969038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-29f5fd8b-db50-4b40-84ae-4a7fe50da951 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1552 microversion: 2.1 time: 0.161801 Sep 13 15:31:33.969631 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 110/221] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:33 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:34.190780 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:34.191442 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:34.197495 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.197957 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.198709 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.199753 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.200194 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.200613 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.226888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:34.227380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:34.237608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.238154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.238802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.239534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.240282 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.240697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.267185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:31:34.362573 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:34.362573 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-084e7571-46c6-402f-8a9e-ec1d28994097 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.176729 Sep 13 15:31:34.363403 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 112/222] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:34 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:34.372324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-641bc880-c675-4472-94cc-93b4ed369965 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "DELETE /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 204 len: 0 microversion: 2.1 time: 0.148992 Sep 13 15:31:34.373030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 111/223] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:31:34 2022] DELETE /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 15:31:34.382587 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:34.383212 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:34.390426 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.390909 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.391350 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.392360 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.392682 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.393107 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.421854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:34.422708 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:34.431684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.432945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.433502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.434563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:34.435147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:34.435572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:34.454909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:34.556057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:34.563777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b200b58a-ce60-4e5a-ae47-9d9cb1d3f574 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1267 microversion: 2.1 time: 0.152436 Sep 13 15:31:34.564673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 112/224] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:34 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:34.585241 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:34.593850 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b83ce550-39b3-400f-8071-98422e707996 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1504 microversion: 2.1 time: 0.215961 Sep 13 15:31:34.595009 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 113/225] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:34 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:34.993326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:34.994042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:35.000574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.001142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.001688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.002492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.002943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.003361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.153962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:35.163646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1284cb74-f29e-4af6-a78e-e19217ec0b24 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1552 microversion: 2.1 time: 0.174934 Sep 13 15:31:35.164229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 113/226] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:34 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:35.391490 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:35.392240 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:35.401031 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.401619 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.402129 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.402920 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.403427 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.403882 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.560200 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:35.568008 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-2ff33139-4233-4dcb-b17c-8230b9b34efe tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.181534 Sep 13 15:31:35.568841 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 114/227] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:35 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:35.588523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:35.589451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:35.596976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.597528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.598205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.599207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.599665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.600090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.621305 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:35.621918 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:35.635539 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.636071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.636648 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.637608 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:35.638238 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:35.638748 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:35.657851 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:35.681295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:35.694237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-22683bcf-3b76-406e-812d-a21bce835ef3 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1267 microversion: 2.1 time: 0.110065 Sep 13 15:31:35.694862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 114/228] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:35 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:35.787583 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:35.797953 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-4869faab-d5b3-4e0d-9134-33aae677099e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1504 microversion: 2.1 time: 0.181744 Sep 13 15:31:35.798964 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 115/229] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:35 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:36.190497 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:36.191454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:36.198885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.199372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.200159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:36.200924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.201502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.201979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:36.354041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:36.363986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b6d3f128-f97d-4fea-b9e6-7502fb35ecbd tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1552 microversion: 2.1 time: 0.177382 Sep 13 15:31:36.365005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 115/230] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:36 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:36.602055 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:36.602607 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:36.609234 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.609851 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.610431 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:36.611092 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.611541 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.611959 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:36.719290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:36.720060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:36.726743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.727228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.727659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:36.728352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.728806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.729224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:36.748571 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:36.756709 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-5a11c3d8-dd60-4cab-8a57-b3a12eeb756e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.159199 Sep 13 15:31:36.757931 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 116/231] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:36 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:36.806137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:36.814998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-62d18159-9b64-4768-b754-f158bacc0fed tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1267 microversion: 2.1 time: 0.099668 Sep 13 15:31:36.827280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 116/232] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:36 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:36.834978 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:36.835725 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:36.847785 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.848367 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.848857 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:36.849621 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:36.850157 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:36.850632 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:37.118241 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:37.127970 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9b496ea3-5882-46f8-bbca-0829095abe32 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1504 microversion: 2.1 time: 0.300319 Sep 13 15:31:37.128688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 117/233] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:36 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:37.390401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:37.391005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:37.397593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:37.398082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:37.398682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:37.399570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:37.400021 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:37.400435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:37.430359 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-72e19334-fa23-4e0c-990a-5baf12e90d51 req-d54c889e-8132-4e20-962b-6ae6f1add7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209db596-6cc6-4312-8e98-1327446778fc", "name": "network-vif-deleted", "tag": "ca686017-271b-4552-bbca-3525460062b2"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:37.440728 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-72e19334-fa23-4e0c-990a-5baf12e90d51 req-d54c889e-8132-4e20-962b-6ae6f1add7d0 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:37.441488 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-72e19334-fa23-4e0c-990a-5baf12e90d51 req-d54c889e-8132-4e20-962b-6ae6f1add7d0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:37.441887 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-72e19334-fa23-4e0c-990a-5baf12e90d51 req-d54c889e-8132-4e20-962b-6ae6f1add7d0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:37.454861 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-72e19334-fa23-4e0c-990a-5baf12e90d51 req-d54c889e-8132-4e20-962b-6ae6f1add7d0 service nova] Creating event network-vif-deleted:ca686017-271b-4552-bbca-3525460062b2 for instance 209db596-6cc6-4312-8e98-1327446778fc on hv-cinder-85743 Sep 13 15:31:37.460625 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-72e19334-fa23-4e0c-990a-5baf12e90d51 req-d54c889e-8132-4e20-962b-6ae6f1add7d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034366 Sep 13 15:31:37.463005 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 118/234] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:31:37.584483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:37.597878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d0094f06-ca4a-47ee-8de2-4601e15ab183 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1552 microversion: 2.1 time: 0.209800 Sep 13 15:31:37.618496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 117/235] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:37 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1552 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:37.783426 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:37.785381 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:37.792736 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:37.793322 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:37.794034 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:37.794750 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:37.795243 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:37.795856 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:37.849101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:37.849815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:37.862885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:37.863444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:37.863912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:37.864626 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:37.865073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:37.865499 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:38.250695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:38.260345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3152a91f-fe42-45b4-8bfd-ffd6a2c604c1 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1273 microversion: 2.1 time: 0.424376 Sep 13 15:31:38.260943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 118/236] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:37 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1273 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:38.266351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-decefda7-85b0-43e1-951d-ed52a631fa0f req-1dd46809-7298-4cb6-8d63-d0d518f675c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3f4ab8-cedc-4b59-a85c-89535bb22caf", "name": "network-vif-deleted", "tag": "cdd622f7-1540-4df3-9a58-fc9530ecac1d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:38.276514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-decefda7-85b0-43e1-951d-ed52a631fa0f req-1dd46809-7298-4cb6-8d63-d0d518f675c7 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:38.277074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-decefda7-85b0-43e1-951d-ed52a631fa0f req-1dd46809-7298-4cb6-8d63-d0d518f675c7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:38.277838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-decefda7-85b0-43e1-951d-ed52a631fa0f req-1dd46809-7298-4cb6-8d63-d0d518f675c7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:38.281639 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:38.290797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-decefda7-85b0-43e1-951d-ed52a631fa0f req-1dd46809-7298-4cb6-8d63-d0d518f675c7 service nova] Creating event network-vif-deleted:cdd622f7-1540-4df3-9a58-fc9530ecac1d for instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf on hv-cinder-85743 Sep 13 15:31:38.291045 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b343b41b-3cac-4374-a6ce-38e0570ee6f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.515013 Sep 13 15:31:38.291638 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 119/237] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:37 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:38.297040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-decefda7-85b0-43e1-951d-ed52a631fa0f req-1dd46809-7298-4cb6-8d63-d0d518f675c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Sep 13 15:31:38.297433 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:38.298319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 119/238] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:38.298508 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:38.310983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:38.311640 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:38.312132 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:38.312945 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:38.313604 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:38.314143 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:38.348099 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:38.348612 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:38.349157 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:38.349617 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.objects.instance [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lazy-loading 'fault' on Instance uuid 209db596-6cc6-4312-8e98-1327446778fc {{(pid=120659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:31:38.398436 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:38.407824 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-1aaaa815-7b41-4cfc-bb95-745d35e46335 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 200 len: 1303 microversion: 2.1 time: 0.114851 Sep 13 15:31:38.408504 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 120/239] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:38 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:38.621917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:38.622716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:38.634118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:38.636310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:38.644221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:38.645128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:38.646595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:38.647719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:38.753486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8dcc087badb43b7a18d294a6e316fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836a885e5c97498db1721adb1a22a05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:38.764988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-798bce9b-0fa6-47f8-8452-bf4b1f64e108 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 200 len: 1345 microversion: 2.1 time: 0.147682 Sep 13 15:31:38.766008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 120/240] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:38 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 1345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:39.286889 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:39.287584 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:39.295788 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.296276 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.296706 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.297404 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.297975 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.298572 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.315375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:39.316258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:39.322495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.323183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.323976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.324858 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.325463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.326029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.548526 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:39.551375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:39.560472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e5707c09-50c9-4a75-949a-56bb5734d875 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.249300 Sep 13 15:31:39.561632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 121/241] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:39 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:39.567103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:39.567940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 209db596-6cc6-4312-8e98-1327446778fc] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:39.577365 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8a0aafe1-08d7-4209-97ce-851eb1950825 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.280618 Sep 13 15:31:39.582797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.583593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.584391 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.585365 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.585812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.586326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.591174 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 121/242] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:39 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:39.604288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] HTTP exception thrown: Instance 209db596-6cc6-4312-8e98-1327446778fc could not be found. Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Request method failure captured: Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc HTTP/1.1 Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIo1FC4xpJTcTH48IPw7AslsH484VP3G_s7ClXyLFsXzzksiEP5n2vwj1YeJb06Z8iFzvKEqdgDLRTVkgSVssjBu7s_Ks1JVU3tsJW-wNKpmeKxm-FTX9edkH6Moh1Sh5Ceb5NMrut6YXlbXafTqlXlrG54uQViln6kfrfi8zApVdo Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 5b820ea465db4802aaa22dbaa4e7397a Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesActionsTest-1621961704 Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:31:39.609786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b820ea465db4802aaa22dbaa4e7397a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b820ea465db4802aaa22dbaa4e7397a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b820ea465db4802aaa22dbaa4e7397a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b820ea465db4802aaa22dbaa4e7397a"}]}] Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesActionsTest-1621961704 Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 5b820ea465db4802aaa22dbaa4e7397a Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesActionsTest-1621961704 Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesActionsTest-1621961704-project Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 5ae72d51e9004670a50362d1206fab21 Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesActionsTest-1621961704-project Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 209db596-6cc6-4312-8e98-1327446778fc could not be found. Sep 13 15:31:39.611536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '209db596-6cc6-4312-8e98-1327446778fc'} Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209db596-6cc6-4312-8e98-1327446778fc could not be found. Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:31:39.612230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209db596-6cc6-4312-8e98-1327446778fc could not be found. Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209db596-6cc6-4312-8e98-1327446778fc could not be found. Sep 13 15:31:39.613444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.616338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Returning 404 to user: Instance 209db596-6cc6-4312-8e98-1327446778fc could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:31:39.617246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6ab347ec-86e3-42d6-9c10-fd99b832a3db tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc" status: 404 len: 111 microversion: 2.1 time: 0.054188 Sep 13 15:31:39.617875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 122/243] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:39 2022] GET /compute/v2.1/servers/209db596-6cc6-4312-8e98-1327446778fc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:39.750269 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-185247381", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "networks": [{"uuid": "305345df-68fe-42b0-9cf7-d911787f4fba"}]}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:39.788769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:39.789467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:39.799753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.800530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.801218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.802288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:39.802964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:39.804580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:39.816478 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.network.neutron [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] validate_networks() for [('305345df-68fe-42b0-9cf7-d911787f4fba', None, None, None, None, None)] {{(pid=120659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:31:39.825682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] HTTP exception thrown: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Request method failure captured: Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf HTTP/1.1 Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIA4WS3Ugve4XZBFutqzSiQJQbjsJ75YtqmQSdiILO4ul_KhXute6eYZj4luXUpMFEkCMhRq1PmqNDoBlsIuAg8MowakD20PAibwyeqLxAU0MbRE8B3h8Ikh40Ze1Rme4qoSPYMbp0n5P7LMWaJVYPRFxzV_bHhjP_Ut5OY6195_Ac Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:31:39.827242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_836a885e5c97498db1721adb1a22a05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}] Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c8dcc087badb43b7a18d294a6e316fe0 Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:39.828430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '4a3f4ab8-cedc-4b59-a85c-89535bb22caf'} Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:31:39.829156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:39.830894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:39.831905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Returning 404 to user: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:31:39.831905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-787c7400-9138-4ae4-993e-978236b7a133 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 404 len: 111 microversion: 2.1 time: 0.044540 Sep 13 15:31:39.831905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 123/244] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:39 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:31:39.991098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:39.994703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:39.997284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:39.998822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:40.006088 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=2 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:40.022309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.023209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.023839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.024755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.025400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.026148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.042397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] HTTP exception thrown: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Request method failure captured: Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf/os-volume_attachments HTTP/1.1 Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIA4WS3Ugve4XZBFutqzSiQJQbjsJ75YtqmQSdiILO4ul_KhXute6eYZj4luXUpMFEkCMhRq1PmqNDoBlsIuAg8MowakD20PAibwyeqLxAU0MbRE8B3h8Ikh40Ze1Rme4qoSPYMbp0n5P7LMWaJVYPRFxzV_bHhjP_Ut5OY6195_Ac Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:31:40.044883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_836a885e5c97498db1721adb1a22a05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}] Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c8dcc087badb43b7a18d294a6e316fe0 Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:40.046057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'server_id': '4a3f4ab8-cedc-4b59-a85c-89535bb22caf'} Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:31:40.046743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:40.048221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:40.050819 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Returning 404 to user: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:31:40.051995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-25234b1b-7dfe-4a28-bed0-ec0e49c391e4 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065094 Sep 13 15:31:40.052640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:31:39 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:40.277518 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Flavor limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:31:40.278216 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Image limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:31:40.278767 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Flavor pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:31:40.279241 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Image pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:31:40.279725 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:31:40.302620 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.303265 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.303658 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.304459 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.304893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.305321 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.314860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-5c6c100f-abba-400d-9ff8-18fae044599a req-3142827e-eb11-45c7-964b-cbbbb77ad778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1660d020-9221-426e-80e4-981c15db937c", "tag": "f63996cb-38b0-4d4c-bcc4-753622ed8156"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:40.323242 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Getting quotas for project 5b820ea465db4802aaa22dbaa4e7397a. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:31:40.325538 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-5c6c100f-abba-400d-9ff8-18fae044599a req-3142827e-eb11-45c7-964b-cbbbb77ad778 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.326132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-5c6c100f-abba-400d-9ff8-18fae044599a req-3142827e-eb11-45c7-964b-cbbbb77ad778 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.326546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-5c6c100f-abba-400d-9ff8-18fae044599a req-3142827e-eb11-45c7-964b-cbbbb77ad778 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.327339 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Getting quotas for user 5ae72d51e9004670a50362d1206fab21 and project 5b820ea465db4802aaa22dbaa4e7397a. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:31:40.338982 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Going to run 1 instances... {{(pid=120659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:31:40.340185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-5c6c100f-abba-400d-9ff8-18fae044599a req-3142827e-eb11-45c7-964b-cbbbb77ad778 service nova] Creating event network-changed:f63996cb-38b0-4d4c-bcc4-753622ed8156 for instance 1660d020-9221-426e-80e4-981c15db937c on hv-cinder-85743 Sep 13 15:31:40.341363 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:31:40.348534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-5c6c100f-abba-400d-9ff8-18fae044599a req-3142827e-eb11-45c7-964b-cbbbb77ad778 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037573 Sep 13 15:31:40.349165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 125/246] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:40.392400 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3de33314-5a98-4a20-814e-5aad34184e0b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645974 Sep 13 15:31:40.393156 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 122/247] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:31:40.406432 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9a5fce60-ca56-421a-9b01-c03518e09cb5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:40.407413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9a5fce60-ca56-421a-9b01-c03518e09cb5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:40.476431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9a5fce60-ca56-421a-9b01-c03518e09cb5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:40.485712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9a5fce60-ca56-421a-9b01-c03518e09cb5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1213 microversion: 2.1 time: 0.084642 Sep 13 15:31:40.486584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 126/248] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:40 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:40.584039 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:40.584731 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:40.591068 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.591561 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.591989 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.592679 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.593131 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.593557 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.602675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:40.603236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:40.609641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.610480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.610592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.611429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:40.611884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:40.612303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:40.797932 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:40.806652 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-71a12cb9-7411-4fdf-9e90-5ae61ea1d37b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.226552 Sep 13 15:31:40.822148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:40.822926 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 123/249] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:40 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:40.833242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8aa86850-2040-4c52-bd52-94a163539caa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.234816 Sep 13 15:31:40.833822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 127/250] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:40 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:41.327937 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:41.329019 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:41.336268 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.336997 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.337449 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.338265 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.338690 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.339129 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.355590 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.wsgi [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] HTTP exception thrown: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Request method failure captured: Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: request: DELETE /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf HTTP/1.1 Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept: application/json Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept-Encoding: identity Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Connection: close Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Length: 0 Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Type: application/json Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Host: 10.222.0.16 Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Openstack-System-Scope: None Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: User-Agent: python-urllib3/1.26.12 Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Auth-Token: gAAAAABjIKIA4WS3Ugve4XZBFutqzSiQJQbjsJ75YtqmQSdiILO4ul_KhXute6eYZj4luXUpMFEkCMhRq1PmqNDoBlsIuAg8MowakD20PAibwyeqLxAU0MbRE8B3h8Ikh40Ze1Rme4qoSPYMbp0n5P7LMWaJVYPRFxzV_bHhjP_Ut5OY6195_Ac Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Id: None Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Name: None Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Identity-Status: Confirmed Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Is-Admin-Project: True Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Id: default Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Name: Default Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Role: reader,member Sep 13 15:31:41.361778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Roles: reader,member Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_836a885e5c97498db1721adb1a22a05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}] Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Id: default Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Name: Default Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Id: c8dcc087badb43b7a18d294a6e316fe0 Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Name: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: method: > Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: exception: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.364165 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: action_args: {'id': '4a3f4ab8-cedc-4b59-a85c-89535bb22caf'} Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:31:41.365618 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.367631 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.369593 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Returning 404 to user: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. {{(pid=120659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:31:41.369593 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-68814161-640f-4999-a8dd-5f17228b54a1 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 404 len: 111 microversion: 2.1 time: 0.039576 Sep 13 15:31:41.369593 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 124/251] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:31:41 2022] DELETE /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:41.381839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:41.382997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] [instance: 4a3f4ab8-cedc-4b59-a85c-89535bb22caf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:41.390508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.391208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.391939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.393355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.394133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.394783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] HTTP exception thrown: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Request method failure captured: Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf HTTP/1.1 Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIA4WS3Ugve4XZBFutqzSiQJQbjsJ75YtqmQSdiILO4ul_KhXute6eYZj4luXUpMFEkCMhRq1PmqNDoBlsIuAg8MowakD20PAibwyeqLxAU0MbRE8B3h8Ikh40Ze1Rme4qoSPYMbp0n5P7LMWaJVYPRFxzV_bHhjP_Ut5OY6195_Ac Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:31:41.418605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_836a885e5c97498db1721adb1a22a05f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/836a885e5c97498db1721adb1a22a05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/836a885e5c97498db1721adb1a22a05f"}]}] Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 836a885e5c97498db1721adb1a22a05f Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-DeleteServersTestJSON-741991521 Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c8dcc087badb43b7a18d294a6e316fe0 Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-DeleteServersTestJSON-741991521-project Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.420155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '4a3f4ab8-cedc-4b59-a85c-89535bb22caf'} Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:31:41.421191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. Sep 13 15:31:41.422680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:31:41.423824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] Returning 404 to user: Instance 4a3f4ab8-cedc-4b59-a85c-89535bb22caf could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:31:41.423824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0977ee26-dd03-4ca5-a08c-770c44329b30 tempest-DeleteServersTestJSON-741991521 tempest-DeleteServersTestJSON-741991521-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf" status: 404 len: 111 microversion: 2.1 time: 0.045144 Sep 13 15:31:41.423824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 128/252] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:41 2022] GET /compute/v2.1/servers/4a3f4ab8-cedc-4b59-a85c-89535bb22caf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:31:41.509353 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:41.510220 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:41.516231 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.516925 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.517338 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.518333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.518936 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.519511 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.612802 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:41.622678 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-77deab5d-071f-4d20-8e70-7068f3eadf13 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1217 microversion: 2.1 time: 0.116635 Sep 13 15:31:41.623578 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 125/253] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:41 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:41.832626 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:41.833783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:41.841437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.842131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.842589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.857327 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:41.857941 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:41.868548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.869759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.870462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.872675 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.875203 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.877229 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:41.878495 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:41.879192 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:41.879821 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:42.227597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:42.233972 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:42.239058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c35bcf2e-43e0-457e-a794-e66df1430e45 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.410791 Sep 13 15:31:42.239647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 129/254] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:41 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:42.247685 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-be03df36-5996-4f03-bee6-1c709708b8a5 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.394343 Sep 13 15:31:42.248762 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 126/255] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:41 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:42.653061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:42.654851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:42.660709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:42.661206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:42.661634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:42.662399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:42.662842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:42.663427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:42.776043 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:42.794944 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-87863821-ec72-4fb6-bddb-0abb627c2689 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1217 microversion: 2.1 time: 0.152416 Sep 13 15:31:42.796128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 130/256] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:42 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:43.271062 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:43.272275 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:43.272872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:43.273747 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:43.281682 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:43.282598 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:43.283409 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:43.284697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:43.285361 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:43.285981 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:43.286567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:43.286762 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:43.288453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:43.289172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:43.291267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:43.291770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:43.611159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:43.626251 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:43.634502 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-17dd7ad0-c5da-422a-a2ec-4a4a51e3ac26 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.373882 Sep 13 15:31:43.635071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 127/257] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:43 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:43.637047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-85dd60cd-7227-4fae-b0bc-9acbb69113f6 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.368822 Sep 13 15:31:43.638193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 131/258] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:43 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:43.823018 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:43.823675 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:43.836508 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:43.837289 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:43.837931 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:43.839228 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:43.839847 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:43.840426 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:43.919359 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:43.927409 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-dca48778-708c-468b-8b56-702c4d9b159e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1265 microversion: 2.1 time: 0.108432 Sep 13 15:31:43.927978 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 128/259] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:43 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:44.659543 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:44.660171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:44.663319 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:44.664428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:44.666923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:44.667839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:44.668444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:44.669307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:44.669911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:44.670510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:44.672358 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:44.672893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:44.673702 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:44.674578 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:44.675179 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:44.675601 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:45.001070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:45.011255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-163ebfa6-5dbe-4e27-8b26-d4642e226981 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.356142 Sep 13 15:31:45.012356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 132/260] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:44 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:45.018408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:45.019792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:45.028454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:45.028956 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:45.029392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:45.030137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:45.030565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:45.031027 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:45.033573 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:45.043028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-4cb5628b-e3fd-46cf-8209-d4936e662516 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.383963 Sep 13 15:31:45.043795 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 129/261] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:44 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:45.111118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:45.115448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:45.120682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-39d25f6c-fb08-4a66-8edf-f1cd62648dbc tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1265 microversion: 2.1 time: 0.107105 Sep 13 15:31:45.121270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 133/262] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:45 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:46.035504 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:46.037312 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:46.043722 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:46.044193 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:46.044802 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:46.045652 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:46.046279 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:46.047212 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:46.069098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:46.070331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:46.084070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:46.084811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:46.085425 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:46.088301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:46.088962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:46.089582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:46.645650 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:46.656057 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3dfd0f6b-6ecc-4ded-87e8-e420fc0b298e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.624736 Sep 13 15:31:46.656648 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 130/263] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:46 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:46.670044 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:46.671086 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:46.676278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:46.685541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-33781783-f942-41b0-ac7b-8058fc550512 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.622493 Sep 13 15:31:46.688886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 134/264] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:46 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:46.699494 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:46.700063 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:46.700563 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:46.701605 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:46.701840 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:46.706353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-1400a68d-045f-4b9a-baf9-230352d75a01 req-ea9bbec7-093c-496e-b119-3a0f214dfa05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1660d020-9221-426e-80e4-981c15db937c", "name": "network-vif-plugged", "status": "completed", "tag": "f63996cb-38b0-4d4c-bcc4-753622ed8156"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:46.717913 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:46.732534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1400a68d-045f-4b9a-baf9-230352d75a01 req-ea9bbec7-093c-496e-b119-3a0f214dfa05 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:46.733023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1400a68d-045f-4b9a-baf9-230352d75a01 req-ea9bbec7-093c-496e-b119-3a0f214dfa05 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:46.733456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1400a68d-045f-4b9a-baf9-230352d75a01 req-ea9bbec7-093c-496e-b119-3a0f214dfa05 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:46.765143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-1400a68d-045f-4b9a-baf9-230352d75a01 req-ea9bbec7-093c-496e-b119-3a0f214dfa05 service nova] Creating event network-vif-plugged:f63996cb-38b0-4d4c-bcc4-753622ed8156 for instance 1660d020-9221-426e-80e4-981c15db937c on hv-cinder-85743 Sep 13 15:31:46.785418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-1400a68d-045f-4b9a-baf9-230352d75a01 req-ea9bbec7-093c-496e-b119-3a0f214dfa05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094372 Sep 13 15:31:46.785966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 135/265] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:46.838466 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:46.847087 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-ff316d26-6a5d-4d92-925a-c6648a879526 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1271 microversion: 2.1 time: 0.185877 Sep 13 15:31:46.850458 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 131/266] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:46 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:47.686452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:47.687169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:47.693375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:47.693865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:47.694322 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:47.695422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:47.696154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:47.696630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:47.713821 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:47.717759 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:47.724615 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:47.725288 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:47.725714 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:47.726662 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:47.727267 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:47.727688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:47.933853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:47.945338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9a5d72c4-d881-4dd7-8857-2497126d8e63 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.267940 Sep 13 15:31:47.958327 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:47.959287 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 136/267] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:47 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:47.970366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:47.972344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:47.972652 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-6d4cd3e1-7bd3-4065-9b62-4fa0e6073742 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.262433 Sep 13 15:31:47.973671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 132/268] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:47 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:47.984964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:47.985579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:47.986072 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:47.988268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:47.988878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:47.989578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:48.154236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:48.165713 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f2fbf464-7123-4360-a594-6b6b774acac3 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.204494 Sep 13 15:31:48.166918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 137/269] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:47 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:48.974579 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:48.975431 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:48.981527 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:48.982006 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:48.982439 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:48.983122 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:48.983597 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:48.984294 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:48.996127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:48.997427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:49.005556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:49.005832 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:49.006451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:49.007055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:49.007957 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:49.008635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:49.009210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:49.546998 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:49.557026 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-069fad0f-29e3-4521-b94a-dc22fc6b492a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.587511 Sep 13 15:31:49.558819 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 133/270] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:48 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:49.565688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:49.566763 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:49.571334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:49.579773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8ba26792-10dc-4328-9d8f-1eead58baf2c tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.587499 Sep 13 15:31:49.580384 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 138/271] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:48 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:49.588517 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:49.589264 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:49.590351 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:49.591616 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:49.592210 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:49.593397 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:49.852952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:49.861313 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-ae0303f1-410a-4e9a-9c93-d67116839ca8 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.301246 Sep 13 15:31:49.863026 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 134/272] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:49 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:50.588966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:50.589936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:50.600281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:50.606714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:50.607684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:50.609489 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:50.610745 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:50.612078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:50.614799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:50.615598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:50.616273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:50.623390 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=2 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:50.624138 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=6 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:50.625647 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:50.626151 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:50.626766 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:50.627653 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:50.630747 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:50.631389 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:51.094404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:51.104485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4a50cda4-1b12-487c-ac71-3cb155a23084 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1521 microversion: 2.1 time: 0.519423 Sep 13 15:31:51.121840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 139/273] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:50 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:51.128109 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:51.128835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:51.135061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:51.135669 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:51.136202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:51.137334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:51.138002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:51.138659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:51.174333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:51.182260 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8db2f110-5923-45d0-8b78-4f45ac72e16b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.576740 Sep 13 15:31:51.200392 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 135/274] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:50 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:51.486825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:51.501226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5c021962-ff15-4be7-8617-939b3d499586 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.377860 Sep 13 15:31:51.503399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 140/275] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:51 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:52.130334 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:52.130932 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:52.137437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.138023 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.138505 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.139453 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.140057 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.140585 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.209045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:52.209696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:52.215117 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:52.216994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.217489 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.217921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.218723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.219352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.220112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.553306 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:52.575959 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-a4aad876-b065-4de9-82be-5c2eae6decd5 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1501 microversion: 2.1 time: 0.449436 Sep 13 15:31:52.576561 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 136/276] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:52 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1501 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:52.582436 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:52.583463 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:52.589745 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.590454 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.591424 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.592144 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.592643 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.593037 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.663450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:52.675565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e12a11f5-36ab-4de5-9fd5-64ce6e8d1525 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1315 microversion: 2.1 time: 0.470231 Sep 13 15:31:52.676892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 141/277] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:52 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:52.681994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:52.683017 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:52.689468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.690273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.690891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.691769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:52.692426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:52.693048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:52.994529 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:53.010424 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-46f8e4f0-b628-42e9-b366-a6560d897958 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.432466 Sep 13 15:31:53.011125 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 137/278] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:52 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:53.017926 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-9cdcccde-cb3d-4d6c-ad73-30400fcb3c65 req-8d396b58-dd53-4b6a-837d-ccedc0d33845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a733f9c-072a-4d48-a807-423d74f654c3", "tag": "acc082f5-9d44-4329-b161-8e4b8f8686eb"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:53.030194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:53.033051 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-9cdcccde-cb3d-4d6c-ad73-30400fcb3c65 req-8d396b58-dd53-4b6a-837d-ccedc0d33845 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:53.033887 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-9cdcccde-cb3d-4d6c-ad73-30400fcb3c65 req-8d396b58-dd53-4b6a-837d-ccedc0d33845 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:53.034430 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-9cdcccde-cb3d-4d6c-ad73-30400fcb3c65 req-8d396b58-dd53-4b6a-837d-ccedc0d33845 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:53.040429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7e62824a-c7cb-42d1-9d57-699e59be219f tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1516 microversion: 2.1 time: 0.362233 Sep 13 15:31:53.041902 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 142/279] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:52 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:53.047063 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-9cdcccde-cb3d-4d6c-ad73-30400fcb3c65 req-8d396b58-dd53-4b6a-837d-ccedc0d33845 service nova] Creating event network-changed:acc082f5-9d44-4329-b161-8e4b8f8686eb for instance 6a733f9c-072a-4d48-a807-423d74f654c3 on hv-cinder-85743 Sep 13 15:31:53.059901 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-9cdcccde-cb3d-4d6c-ad73-30400fcb3c65 req-8d396b58-dd53-4b6a-837d-ccedc0d33845 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046683 Sep 13 15:31:53.060744 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 138/280] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:31:53.701769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:53.703203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:53.720241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:53.721122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:53.722420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:53.724429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:53.733763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:53.734637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.037007 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:54.037702 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:54.047762 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.052667 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.053578 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.059620 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.061016 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.061894 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.142144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:54.153617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ec523a7b-bd43-4ae1-85b9-e77705f621aa tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1464 microversion: 2.1 time: 0.455544 Sep 13 15:31:54.154720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 143/281] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:53 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1464 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:54.208251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:54.209725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:54.221442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.222662 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.223274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.230266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.230945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.231586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.260445 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:31:54.335819 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:54.348363 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-ea464d51-dca1-47eb-8209-64a2c0aacbc5 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.315683 Sep 13 15:31:54.368120 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 139/282] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:54 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:54.389038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-36a4ac7d-7bdc-4442-aeaa-0e712bb78104 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 204 len: 0 microversion: 2.1 time: 0.187232 Sep 13 15:31:54.393165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 144/283] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:31:54 2022] DELETE /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:31:54.399006 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:54.399888 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:54.413511 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.414077 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.414658 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.415501 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.416028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.416514 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.522631 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:54.525358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:54.539719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.542869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.543641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.544788 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.545260 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.545690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.601352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lazy-loading 'flavor' on Instance uuid ecad0016-167e-481d-bc1a-44f01c614a59 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:31:54.727765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-808fa796-4ed4-42d0-a7fc-f976e63a2256 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59/action" status: 200 len: 32 microversion: 2.1 time: 0.209981 Sep 13 15:31:54.733046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 145/284] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:31:54 2022] POST /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 15:31:54.742408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:54.743335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:54.752467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.752968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.753454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.754196 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:54.754900 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:54.755484 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:54.789587 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:54.803160 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-15816310-dc55-4f85-b02e-fca1fe024330 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1470 microversion: 2.1 time: 0.404012 Sep 13 15:31:54.804052 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 140/285] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:54 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1470 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:54.987360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:54.996246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ca00f03c-7649-40bc-810e-b9e3b04ae854 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.260530 Sep 13 15:31:54.999032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 146/286] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:54 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:55.373783 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:55.374651 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:55.380945 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:55.381437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:55.381866 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:55.385333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:55.385333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:55.385333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:55.568333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:55.579140 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-7d4a81a1-e49b-48fd-aa01-98f38dada343 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.209118 Sep 13 15:31:55.580171 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 141/287] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:55 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:55.716170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-93f8af06-1ef0-41f4-80dd-c29c2360c677 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: .version_select at 0x7f4bbf6624c0>, body: {"keypair": {"name": "tempest-keypair-1858115316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBktkJH47uIRPbHbFe+Qoq3h0JTlnUt+Piot/uuQUGlqrv4yTVV3b8O/YaPiyz163uA59OviBtd/BSozvaG0bPbikm66AjolQ+csii+gRRKqoJ8S5PsU34xeUsV60IqqqA=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:55.732652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-93f8af06-1ef0-41f4-80dd-c29c2360c677 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:31:55.737407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-93f8af06-1ef0-41f4-80dd-c29c2360c677 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:31:55.763603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-93f8af06-1ef0-41f4-80dd-c29c2360c677 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.366694 Sep 13 15:31:55.772020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 147/288] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:31:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:31:55.828791 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:55.829307 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:55.839218 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:55.840248 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:55.840759 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:55.842253 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:55.842963 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:55.843370 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:56.021882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:56.022916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:56.031391 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:56.032175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:56.032805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:56.033847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:56.034659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:56.035352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:56.060732 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:56.062838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:56.069717 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-ee0d7f35-c718-46e8-82f7-1f5af3f6e23b tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1470 microversion: 2.1 time: 0.244862 Sep 13 15:31:56.073017 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 142/289] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:55 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:56.354263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:56.368259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e29d9e26-4a15-4b6a-ab35-0f9e26b13c0e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.350998 Sep 13 15:31:56.369868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 148/290] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:56 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:56.605837 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:56.606688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:56.617737 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:56.619730 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:56.620243 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:56.621390 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:56.622447 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:56.622447 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:56.887198 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:56.902301 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-2024ecc3-f274-4cfb-81bb-b26d16449a08 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.300237 Sep 13 15:31:56.903779 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 143/291] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:56 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:57.102251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:57.103633 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:57.121884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:57.122803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:57.123939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:57.124853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:57.125468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:57.126046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:57.400178 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:57.401114 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:57.412192 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:57.413427 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:57.413960 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:57.414921 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:57.415471 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:57.415956 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:57.885981 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:57.899104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-951f6af2-0dd2-408d-8e13-852ef6fb4137 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1470 microversion: 2.1 time: 0.803733 Sep 13 15:31:57.899810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 149/292] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:57 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1470 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:57.910683 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:57.931486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:57.932244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:57.938965 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f1123286-3fbf-423a-bc4e-9c7d344d1701 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.523065 Sep 13 15:31:57.939668 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 144/293] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:57 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:57.945971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:57.947762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:57.948251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:57.948977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:57.949567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:57.950418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:58.004878 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2071908352", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dae42ed5-9203-4331-a516-9ad32fc49ad2"}], "security_groups": [{"name": "tempest-securitygroup--1026971607"}], "key_name": "tempest-keypair-1858115316", "user_data": "}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:31:58.309274 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.network.neutron [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] validate_networks() for [('dae42ed5-9203-4331-a516-9ad32fc49ad2', None, None, None, None, None)] {{(pid=120659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:31:58.473392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:58.489864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-da975813-a6ab-42d5-b91e-210958cea1c4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.560983 Sep 13 15:31:58.490986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 150/294] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:57 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:31:58.925236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:58.926233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:58.939388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:58.940375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:58.941625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:58.943424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:58.944909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:58.945412 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:59.540719 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:31:59.542208 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:31:59.542826 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:31:59.543385 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:31:59.543936 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:31:59.555622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:31:59.568180 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:59.568666 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:59.569055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4ca45487-aac3-47d3-bef8-82b390a9b7f9 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1470 microversion: 2.1 time: 0.647780 Sep 13 15:31:59.569199 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:59.569799 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:59.570265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 151/295] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:58 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:31:59.584058 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:59.584593 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:59.586648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:59.587425 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:59.602658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:59.603359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:59.603958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:59.604848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:59.605451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:59.606023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:59.649111 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:31:59.662078 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:31:59.669947 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:31:59.691888 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Going to run 1 instances... {{(pid=120659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:31:59.695689 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:31:59.793605 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9aeada1f-eaff-48ed-b23a-8d2af1f98439 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.793890 Sep 13 15:31:59.800799 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 145/296] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:31:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:31:59.805834 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:31:59.806667 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:31:59.813952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:59.814778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:59.815408 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:31:59.817164 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:31:59.817767 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:31:59.818412 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:00.045267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:00.053765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-709f449c-ba33-4996-812b-1a66daf1b09c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.482291 Sep 13 15:32:00.065025 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 152/297] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:59 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:00.086408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-865dd3ca-749f-477b-b69b-0c11536c099a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:00.087028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-865dd3ca-749f-477b-b69b-0c11536c099a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:00.286233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-865dd3ca-749f-477b-b69b-0c11536c099a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:00.295838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-865dd3ca-749f-477b-b69b-0c11536c099a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1242 microversion: 2.1 time: 0.213290 Sep 13 15:32:00.296431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 153/298] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:00 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1242 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:00.324353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-9253e08c-a24b-4a54-862f-ca6e4908b575 req-b98d76ad-4a31-4dfe-986c-2c9935cf357d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1660d020-9221-426e-80e4-981c15db937c", "name": "network-vif-deleted", "tag": "f63996cb-38b0-4d4c-bcc4-753622ed8156"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:00.356331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-9253e08c-a24b-4a54-862f-ca6e4908b575 req-b98d76ad-4a31-4dfe-986c-2c9935cf357d service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:00.357330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-9253e08c-a24b-4a54-862f-ca6e4908b575 req-b98d76ad-4a31-4dfe-986c-2c9935cf357d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:00.359613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-9253e08c-a24b-4a54-862f-ca6e4908b575 req-b98d76ad-4a31-4dfe-986c-2c9935cf357d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:00.380894 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:00.389367 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-5a26516f-3e1b-4c42-8b7b-f0d570fe267c tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.587390 Sep 13 15:32:00.395484 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 146/299] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:31:59 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:00.396787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-9253e08c-a24b-4a54-862f-ca6e4908b575 req-b98d76ad-4a31-4dfe-986c-2c9935cf357d service nova] Creating event network-vif-deleted:f63996cb-38b0-4d4c-bcc4-753622ed8156 for instance 1660d020-9221-426e-80e4-981c15db937c on hv-cinder-85743 Sep 13 15:32:00.409294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-9253e08c-a24b-4a54-862f-ca6e4908b575 req-b98d76ad-4a31-4dfe-986c-2c9935cf357d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100502 Sep 13 15:32:00.415745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 154/300] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:00.601163 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:00.602467 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:00.609788 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:00.610338 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:00.611648 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:00.612737 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:00.613408 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:00.614401 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:00.654849 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:00.655635 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:00.656345 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:00.656803 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.objects.instance [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lazy-loading 'fault' on Instance uuid 1660d020-9221-426e-80e4-981c15db937c {{(pid=120659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:32:00.962339 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc6dff55e847ba93eb7bfdcf4e95b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b581d18eee429cb4415287c1887fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:00.971840 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-7bec37a1-ee3f-40e1-9b2a-04af88e552d4 tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 200 len: 1305 microversion: 2.1 time: 0.376133 Sep 13 15:32:00.972992 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 147/301] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:00 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 1305 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:01.089698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:01.091277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:01.098692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:01.099455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:01.101327 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:01.102481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:01.103148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:01.104391 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:01.320127 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:01.321172 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:01.327289 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:01.327849 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:01.328398 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:01.329268 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:01.329899 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:01.330450 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:01.431585 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:01.441713 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-c11391d9-6bc9-466c-99a9-7c4dc28c10da tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1294 microversion: 2.1 time: 0.126424 Sep 13 15:32:01.442420 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 148/302] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:01 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:01.460663 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:01.461276 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:01.474961 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:01.475448 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:01.475875 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:01.476574 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:01.477022 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:01.477588 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:01.492378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:01.503097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-21973f19-6efb-4fcc-b04a-c8148b972773 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.418431 Sep 13 15:32:01.516080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 155/303] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:01 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:01.663219 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:01.689056 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-fc5f9d19-b97a-4873-bbf8-e8e98989ad22 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.231998 Sep 13 15:32:01.689879 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 149/304] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:01 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:01.996587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:01.997443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] [instance: 1660d020-9221-426e-80e4-981c15db937c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:02.004456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.005197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.005790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.006686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.007280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.007858 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.024062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] HTTP exception thrown: Instance 1660d020-9221-426e-80e4-981c15db937c could not be found. Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Request method failure captured: Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c HTTP/1.1 Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJMoiTDEaxCGYZ0Nnlk84m14Tfo_6xvZHJmVksjLaeajLIU1h_CRGkAt6DwkLcdGlHfdK5U3ilOMxK55jV5J4o3xx1AjglLXv9DMWZVfj-BOkqpVcWoK904Q-XqRN-_T9B9N5s0TT8ksdmCgaTYB-9jdnk_bC5HKuqOou79X8Gn0b0 Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: c1b581d18eee429cb4415287c1887fa7 Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesNegativeTest-994345041 Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:32:02.026460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1b581d18eee429cb4415287c1887fa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1b581d18eee429cb4415287c1887fa7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1b581d18eee429cb4415287c1887fa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1b581d18eee429cb4415287c1887fa7"}]}] Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesNegativeTest-994345041 Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: c1b581d18eee429cb4415287c1887fa7 Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesNegativeTest-994345041 Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesNegativeTest-994345041-project Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 47bc6dff55e847ba93eb7bfdcf4e95b2 Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesNegativeTest-994345041-project Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 1660d020-9221-426e-80e4-981c15db937c could not be found. Sep 13 15:32:02.027913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '1660d020-9221-426e-80e4-981c15db937c'} Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1660d020-9221-426e-80e4-981c15db937c could not be found. Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:32:02.028860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1660d020-9221-426e-80e4-981c15db937c could not be found. Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1660d020-9221-426e-80e4-981c15db937c could not be found. Sep 13 15:32:02.030094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:02.032444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] Returning 404 to user: Instance 1660d020-9221-426e-80e4-981c15db937c could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:32:02.033648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b08cf497-706c-4256-b042-7678e27b161a tempest-VolumesNegativeTest-994345041 tempest-VolumesNegativeTest-994345041-project] 10.222.0.16 "GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c" status: 404 len: 111 microversion: 2.1 time: 0.040829 Sep 13 15:32:02.034729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 156/305] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:01 2022] GET /compute/v2.1/servers/1660d020-9221-426e-80e4-981c15db937c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:32:02.143969 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-22a8ce77-0ea8-4aa7-8d2a-665a133ae6a7 req-71cb3678-b6c6-40d6-b834-8c081b190010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a733f9c-072a-4d48-a807-423d74f654c3", "name": "network-vif-plugged", "status": "completed", "tag": "acc082f5-9d44-4329-b161-8e4b8f8686eb"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:02.166844 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-22a8ce77-0ea8-4aa7-8d2a-665a133ae6a7 req-71cb3678-b6c6-40d6-b834-8c081b190010 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.167364 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-22a8ce77-0ea8-4aa7-8d2a-665a133ae6a7 req-71cb3678-b6c6-40d6-b834-8c081b190010 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.167783 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-22a8ce77-0ea8-4aa7-8d2a-665a133ae6a7 req-71cb3678-b6c6-40d6-b834-8c081b190010 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.184978 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-22a8ce77-0ea8-4aa7-8d2a-665a133ae6a7 req-71cb3678-b6c6-40d6-b834-8c081b190010 service nova] Creating event network-vif-plugged:acc082f5-9d44-4329-b161-8e4b8f8686eb for instance 6a733f9c-072a-4d48-a807-423d74f654c3 on hv-cinder-85743 Sep 13 15:32:02.193960 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-22a8ce77-0ea8-4aa7-8d2a-665a133ae6a7 req-71cb3678-b6c6-40d6-b834-8c081b190010 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053846 Sep 13 15:32:02.195267 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 150/306] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:02.474089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:02.475478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:02.485727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.488247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.489751 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.491570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.492423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.494346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.527468 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:02.528282 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:02.544839 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.547124 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.548778 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.549511 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.549965 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.550414 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.619623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:02.637450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c275a948-868b-4830-922e-1a39674e63e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1300 microversion: 2.1 time: 0.168018 Sep 13 15:32:02.638778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 157/307] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:02 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:02.723869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:02.726718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:02.736706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.741603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.744230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.747019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:02.747952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:02.749861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:02.872010 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:02.891591 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=100 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:02.901993 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-0a45e508-d201-4b96-adec-3dcb2740f5d4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.378843 Sep 13 15:32:02.904389 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 151/308] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:02 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:02.999124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:03.009774 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f6c31c4-4c35-4169-bd3f-3317ad04ab5e tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.295573 Sep 13 15:32:03.031817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 158/309] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:02 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:03.667227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:03.667832 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:03.685860 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:03.686385 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:03.686808 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:03.687509 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:03.687955 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:03.688368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:03.927360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:03.928567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:03.938171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:03.940555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:03.941048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:03.955145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:03.955642 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:03.956253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:04.229890 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:04.240809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:04.246670 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-d2cdaeb6-bb09-411d-acf0-8d7c9fe967eb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.584112 Sep 13 15:32:04.248791 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 152/310] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:03 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:04.251876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-febf8bf8-ff93-440f-8a0d-84815829e417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.328514 Sep 13 15:32:04.257817 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:04.258490 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:04.266029 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:04.268887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 159/311] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:03 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:04.272289 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:04.272891 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:04.273547 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:04.274010 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:04.274483 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:04.501423 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:04.511492 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-581af7cb-352b-44e2-b6e3-929aaa28af9d tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1313 microversion: 2.1 time: 0.261625 Sep 13 15:32:04.512966 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 153/312] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:04 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:05.281795 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:05.282576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:05.286825 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:05.287438 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:05.299937 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:05.299937 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:05.299937 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:05.300284 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:05.307142 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:05.307649 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:05.317166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:05.317942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:05.319125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:05.320652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:05.321564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:05.322245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:05.683174 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:05.698842 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f3722cfb-6798-46b2-9efb-4b4bebf488ef tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.421801 Sep 13 15:32:05.698842 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 154/313] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:05 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:05.706123 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-5a73687d-50ee-4267-a36b-1e324d433666 req-3fcf8d88-fc69-423c-8b2a-7ad5f755bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec25cef-3608-4af4-a0ff-119c601b2cb2", "tag": "bf95274d-7cad-4bd2-aa20-8fe6600a24ff"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:05.707866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:05.720125 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-5a73687d-50ee-4267-a36b-1e324d433666 req-3fcf8d88-fc69-423c-8b2a-7ad5f755bef0 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:05.721033 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-5a73687d-50ee-4267-a36b-1e324d433666 req-3fcf8d88-fc69-423c-8b2a-7ad5f755bef0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:05.721689 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-5a73687d-50ee-4267-a36b-1e324d433666 req-3fcf8d88-fc69-423c-8b2a-7ad5f755bef0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:05.723521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f544a33b-350d-4aab-8157-bf2f893c2477 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.452950 Sep 13 15:32:05.724266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 160/314] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:05 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:05.729200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:05.729794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:05.736581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:05.737102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:05.737541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:05.738580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:05.739230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:05.740011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:05.743354 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-5a73687d-50ee-4267-a36b-1e324d433666 req-3fcf8d88-fc69-423c-8b2a-7ad5f755bef0 service nova] Creating event network-changed:bf95274d-7cad-4bd2-aa20-8fe6600a24ff for instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 on hv-cinder-85743 Sep 13 15:32:05.749599 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-5a73687d-50ee-4267-a36b-1e324d433666 req-3fcf8d88-fc69-423c-8b2a-7ad5f755bef0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050543 Sep 13 15:32:05.751435 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 155/315] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:05.944799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:05.955183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a1b3b2c5-8ea3-41c4-ac1b-8e44f7590418 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1497 microversion: 2.1 time: 0.227097 Sep 13 15:32:05.955403 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 161/316] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:05 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:06.675082 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:06.677525 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:06.693430 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:06.694717 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:06.695353 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:06.696282 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:06.696929 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:06.697540 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:06.736847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:06.737442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:06.741495 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Going to try to terminate instance {{(pid=120659) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:32:06.760702 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:06.768494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:06.779822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:06.784622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:06.785679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:06.788346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:06.905531 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-374c14af-74ae-4de8-8d1c-44d8f323391b tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 204 len: 0 microversion: 2.1 time: 0.235013 Sep 13 15:32:06.906354 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 156/317] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:32:06 2022] DELETE /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:32:06.917947 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:06.918685 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:06.925741 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:06.926480 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:06.927214 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:06.927935 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:06.928692 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:06.929115 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:07.241727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:07.251788 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b163ff86-20fb-48b0-b7d8-29e44262ae78 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.530169 Sep 13 15:32:07.253108 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 162/318] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:06 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:07.258152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:07.259057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:07.267579 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:07.276946 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-81c38a68-5dac-43ee-9f79-1221232806d8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.369008 Sep 13 15:32:07.279265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:07.281387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:07.281875 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 157/319] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:06 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:07.282792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:07.283769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:07.284349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:07.285002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:07.597071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:07.621179 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c2f1dc2b-8ff2-4e9f-9ebe-67b4a18a6d3a tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1503 microversion: 2.1 time: 0.366818 Sep 13 15:32:07.622814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 163/320] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:07 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:08.277221 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:08.278007 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:08.284830 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:08.285613 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:08.286340 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:08.287246 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:08.287698 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:08.288513 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:08.305676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:08.306323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:08.319165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:08.320105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:08.321732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:08.324798 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:08.325394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:08.325971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:08.940432 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:08.949047 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-2c02ea17-518e-41fb-b637-b71efd5724b7 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.676416 Sep 13 15:32:08.949623 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 158/321] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:08 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:08.954917 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:08.955694 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:08.961677 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:08.962372 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:08.962942 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:08.963785 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:08.964385 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:08.964949 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:09.045602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:09.056729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a3787681-1ffe-4bf9-b0f7-f4c5240975fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.754999 Sep 13 15:32:09.070237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 164/322] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:08 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:09.261764 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:09.274805 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-63521735-dd34-47f4-a83f-901cf55dddc4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1503 microversion: 2.1 time: 0.323372 Sep 13 15:32:09.275315 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 159/323] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:08 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:09.974415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:09.975748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:09.982995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:09.984242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:09.984897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:09.986585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:09.987419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:09.988054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:10.084636 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:10.086013 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:10.097749 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=2 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:10.100994 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=6 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:10.103302 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:10.127697 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:10.128054 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:10.130875 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:10.134659 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:10.135281 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:10.266268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:10.287001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a5f6481c-a92a-4000-badc-8f64c26e33e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.317031 Sep 13 15:32:10.290003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 165/324] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:09 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:10.328252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:10.329333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:10.349016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:10.365201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:10.366121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:10.367109 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:10.368269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:10.368875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:10.369568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:10.517067 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:10.525627 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-809f59b9-8f6b-44f7-a52e-a07b998b0eed tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.447062 Sep 13 15:32:10.527102 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 160/325] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:10 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:10.677916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:10.690950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b3d1355d-ad75-4bb6-9143-c5942a3cd7d4 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1503 microversion: 2.1 time: 0.382630 Sep 13 15:32:10.692609 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 166/326] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:10 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:11.312808 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:11.313526 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:11.320733 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:11.320733 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:11.320733 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:11.321718 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:11.322516 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:11.323345 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:11.550812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:11.552140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:11.559559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:11.561038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:11.561701 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:11.562691 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:11.563390 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:11.564043 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:11.586867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:11.629298 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:11.653813 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f16ec1ec-b2f8-4e07-8d27-ea115fa15f3e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.345704 Sep 13 15:32:11.655800 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 161/327] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:11 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:11.717433 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:11.728146 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:11.741550 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:11.742392 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:11.743033 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:11.743978 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:11.744671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:11.745337 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:11.975811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:11.992237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-733c61a6-6ca4-412c-a909-2a02d3a35155 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.445302 Sep 13 15:32:11.994499 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 167/328] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:11 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:12.100905 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:12.109183 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-cbc8e911-6280-41e9-93b2-353ed969a779 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1503 microversion: 2.1 time: 0.395976 Sep 13 15:32:12.111258 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 162/329] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:11 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:12.436931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cc188313-363b-43b1-ac81-72f705832770 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Action: 'create', calling method: .version_select at 0x7f4bbf668280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-806206350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLdNExHynE61c0DprwhY7tbXbwNjOZgo/4ovCUq/XsRJDyV7CZRsF/YZmzM43B01H26/4cXejOChACXHFogxQQ6NuvpIuDEDhkJmQ/Ahbspq8RpegBMCABMHMJQ3/F3Ug=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:12.480360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-cc188313-363b-43b1-ac81-72f705832770 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Getting quotas for project f99e1e9c3c13491e86734af2b526fc42. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:32:12.488131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-cc188313-363b-43b1-ac81-72f705832770 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Getting quotas for user 1dbbc500cd8c4cedb3784d7750cb6de2 and project f99e1e9c3c13491e86734af2b526fc42. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:32:12.522807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cc188313-363b-43b1-ac81-72f705832770 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.271460 Sep 13 15:32:12.541971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 168/330] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:32:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:12.679526 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:12.681075 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:12.690275 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:12.691219 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:12.692114 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:12.694071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:12.695098 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:12.695986 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:13.016613 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:13.020574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:13.021330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:13.029354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:13.030265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:13.030907 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:13.032071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-ffce6f5b-21eb-4a66-afa4-f6b7f9f40ea6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.357536 Sep 13 15:32:13.032307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:13.039444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:13.041431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:13.042335 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 163/331] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:12 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:13.139566 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:13.140189 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:13.147772 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:13.148603 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:13.149260 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:13.149994 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:13.150553 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:13.150974 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:13.410361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:13.420228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c00907ac-b5c4-468e-8465-aba0643e8b06 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.407093 Sep 13 15:32:13.421141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 169/332] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:13 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:13.657085 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:13.686717 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-ab2f1781-2f48-4d63-9d28-6e9e2492f7e0 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1503 microversion: 2.1 time: 0.551553 Sep 13 15:32:13.698378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 164/333] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:13 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1503 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:14.060170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:14.060839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:14.069287 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-b1b0f3c9-85a9-46db-b349-182af0c8d216 req-e0d15421-3ce1-4eb7-bbab-f62655e00d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec25cef-3608-4af4-a0ff-119c601b2cb2", "name": "network-vif-plugged", "status": "completed", "tag": "bf95274d-7cad-4bd2-aa20-8fe6600a24ff"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:14.079067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:14.079479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:14.079927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:14.080982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:14.081119 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:14.081545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:14.106776 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-b1b0f3c9-85a9-46db-b349-182af0c8d216 req-e0d15421-3ce1-4eb7-bbab-f62655e00d02 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:14.107283 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-b1b0f3c9-85a9-46db-b349-182af0c8d216 req-e0d15421-3ce1-4eb7-bbab-f62655e00d02 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:14.107742 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-b1b0f3c9-85a9-46db-b349-182af0c8d216 req-e0d15421-3ce1-4eb7-bbab-f62655e00d02 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:14.152988 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-b1b0f3c9-85a9-46db-b349-182af0c8d216 req-e0d15421-3ce1-4eb7-bbab-f62655e00d02 service nova] Creating event network-vif-plugged:bf95274d-7cad-4bd2-aa20-8fe6600a24ff for instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 on hv-cinder-85743 Sep 13 15:32:14.164498 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-b1b0f3c9-85a9-46db-b349-182af0c8d216 req-e0d15421-3ce1-4eb7-bbab-f62655e00d02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098725 Sep 13 15:32:14.173268 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 165/334] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:14.445847 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:14.448414 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:14.462413 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:14.462914 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:14.463420 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:14.464045 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:14.464493 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:14.465194 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:14.856789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:14.872659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1fd26b57-601f-4ef6-b428-4ca2941f57fd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.816362 Sep 13 15:32:14.879729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 170/335] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:14 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:14.891189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:14.892166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:14.918988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:14.923929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:14.927502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:14.930481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:14.932454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:14.933833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:15.059457 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:15.077101 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-c3202fc4-49c1-47c2-88bd-bfaf3fab2c0d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.635473 Sep 13 15:32:15.078738 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 166/336] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:14 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:15.439690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:15.464978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bccba4a6-426b-4181-8da8-9fa5f6233dde tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1503 microversion: 2.1 time: 0.580332 Sep 13 15:32:15.466145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 171/337] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:14 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1503 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:15.839660 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-e5b0c407-1070-4d77-9464-4d3d8cf61ed1 req-9337d6b1-0490-43e8-920f-98b625c5dd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a733f9c-072a-4d48-a807-423d74f654c3", "name": "network-vif-deleted", "tag": "acc082f5-9d44-4329-b161-8e4b8f8686eb"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:15.878003 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-e5b0c407-1070-4d77-9464-4d3d8cf61ed1 req-9337d6b1-0490-43e8-920f-98b625c5dd1e service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:15.882562 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-e5b0c407-1070-4d77-9464-4d3d8cf61ed1 req-9337d6b1-0490-43e8-920f-98b625c5dd1e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:15.883047 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-e5b0c407-1070-4d77-9464-4d3d8cf61ed1 req-9337d6b1-0490-43e8-920f-98b625c5dd1e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:15.897087 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-e5b0c407-1070-4d77-9464-4d3d8cf61ed1 req-9337d6b1-0490-43e8-920f-98b625c5dd1e service nova] Creating event network-vif-deleted:acc082f5-9d44-4329-b161-8e4b8f8686eb for instance 6a733f9c-072a-4d48-a807-423d74f654c3 on hv-cinder-85743 Sep 13 15:32:15.902878 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-e5b0c407-1070-4d77-9464-4d3d8cf61ed1 req-9337d6b1-0490-43e8-920f-98b625c5dd1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070772 Sep 13 15:32:15.903475 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 167/338] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:15.917064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:15.917681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:15.926213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:15.926962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:15.927590 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:15.928468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:15.929075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:15.929718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:16.116102 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:16.117328 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:16.127205 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:16.128173 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:16.128783 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:16.130016 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:16.130862 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:16.131470 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:16.157649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:16.172976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-311f993c-abd8-489c-94c9-8c49efbe5e48 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.259667 Sep 13 15:32:16.173587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 172/339] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:15 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:16.405848 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:16.431038 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:16.456573 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-6faeffed-defa-4544-8687-f1de941f4704 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.345888 Sep 13 15:32:16.470820 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 168/340] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:16 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:16.493591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:16.496215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:16.507557 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:16.509488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:16.510013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:16.510845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:16.511313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:16.512067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:16.694041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:16.714546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-be0e3e7c-7681-4d05-a2a6-7b9b90573ab7 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1461 microversion: 2.1 time: 0.225275 Sep 13 15:32:16.716469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 173/341] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:16 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1461 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:17.196920 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:17.197522 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:17.226344 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:17.228608 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:17.234957 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:17.240004 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:17.246665 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:17.247469 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:17.462641 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:17.471272 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-66a5c1b7-169e-46af-9b7f-5ec751497e81 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.278096 Sep 13 15:32:17.472084 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 169/342] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:17 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:17.496187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:17.497446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:17.504141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:17.504937 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:17.505570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:17.506766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:17.507217 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:17.508000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:17.672862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:17.681296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2df45c3d-31ea-4fb3-abb8-3022467a1f75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.188870 Sep 13 15:32:17.681900 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 174/343] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:17 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:17.739421 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:17.740021 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:17.746442 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:17.746923 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:17.747357 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:17.748048 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:17.748489 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:17.748901 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:17.817359 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:17.824992 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-7f0d0960-0b46-4cb3-a10d-c7f591ec3e67 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1461 microversion: 2.1 time: 0.089569 Sep 13 15:32:17.825833 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 170/344] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:17 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:18.497830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:18.499290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:18.508486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:18.509249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:18.510417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:18.511484 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:18.526839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:18.527790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:18.704831 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:18.705814 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:18.714836 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:18.715332 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:18.717941 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:18.719145 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:18.719792 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:18.720223 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:18.754155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:18.763393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e8048336-996d-480a-9ff0-e7c04edf0a38 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.272472 Sep 13 15:32:18.769182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 175/345] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:18 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:18.851310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:18.852114 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:18.884710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:18.885227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:18.885674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:18.898696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:18.899222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:18.899873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:19.023214 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:19.031708 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a6ab8008-f8cc-4058-9093-4c48cf3233de tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1461 microversion: 2.1 time: 0.184346 Sep 13 15:32:19.050762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 176/346] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:18 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1461 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:19.083538 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:19.108411 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-ffb968e0-161f-48f3-a474-28ca66f10c4c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.407436 Sep 13 15:32:19.119651 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 171/347] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:18 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:19.793838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:19.795365 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:19.797608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:19.808973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:19.809792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:19.810499 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:19.825089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:19.825677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:19.827334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.040433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:20.055181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cf257e2f-524d-4955-93b6-08aeb819eae8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1502 microversion: 2.1 time: 0.261467 Sep 13 15:32:20.056213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 177/348] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:19 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:20.076939 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:20.077558 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:20.082490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "686492c4-a3d4-4daa-a098-e00b30b109fa"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:20.085016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:20.091475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.092147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.092742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.098357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.103925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.106402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.124140 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.124751 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.125234 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.130565 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.145808 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.146297 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.195627 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] HTTP exception thrown: Cannot 'attach_volume' instance ecad0016-167e-481d-bc1a-44f01c614a59 while it is in vm_state rescued Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Request method failure captured: Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: POST /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59/os-volume_attachments HTTP/1.1 Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 74 Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDu5gSlDj_2xS0l19tkew5jUPNXHSUDlZxnth8rcpscPiH0UQO2fdUlp9i-NCt2Jpx5NpR7etGwnPFFRH9fXozIirkXcNGhupSa4F53gx3DHtg5G5hpt0kPSKruQrtlKLVXKZeDyf7kEG9EcXzEWmRQoXDmea0r89AYjOoEaey2vs Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:32:20.198434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}] Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 97189d5c87c94be2bef7cff79c471c7d Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {"volumeAttachment": {"volumeId": "686492c4-a3d4-4daa-a098-e00b30b109fa"}} Sep 13 15:32:20.199794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Cannot 'attach_volume' instance ecad0016-167e-481d-bc1a-44f01c614a59 while it is in vm_state rescued Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'server_id': 'ecad0016-167e-481d-bc1a-44f01c614a59', 'body': {'volumeAttachment': {'volumeId': '686492c4-a3d4-4daa-a098-e00b30b109fa'}}} Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ecad0016-167e-481d-bc1a-44f01c614a59 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:32:20.205163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ecad0016-167e-481d-bc1a-44f01c614a59 while it is in vm_state rescued Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:32:20.207315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ecad0016-167e-481d-bc1a-44f01c614a59 while it is in vm_state rescued Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Returning 409 to user: Cannot 'attach_volume' instance ecad0016-167e-481d-bc1a-44f01c614a59 while it is in vm_state rescued {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5babfea7-1d0e-4fdc-a88e-07a203abea76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121971 Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 178/349] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:32:20 2022] POST /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59/os-volume_attachments => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 15:32:20.211078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:20.212408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:20.215454 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.215948 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.216381 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.216833 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.objects.instance [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lazy-loading 'fault' on Instance uuid 6a733f9c-072a-4d48-a807-423d74f654c3 {{(pid=120659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:32:20.219314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.219818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.220424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.221473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.222156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.222794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.296395 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:20.306506 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-8435b737-2813-4501-a852-321e887182a1 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1303 microversion: 2.1 time: 0.253327 Sep 13 15:32:20.307105 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 172/350] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:20 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:20.320843 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:20.321388 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:20.336529 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.337027 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.337463 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.338202 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.338662 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.339088 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.521827 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-4a89a4bf-55c1-400e-b8e1-b389fa7bf0a9 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59/action" status: 202 len: 0 microversion: 2.1 time: 0.213372 Sep 13 15:32:20.522880 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 173/351] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:32:20 2022] POST /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:32:20.532660 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:20.533924 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:20.540098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:20.548247 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.549073 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.549227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-156800dc-da42-48fd-a40e-9faba9b8af6e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.347175 Sep 13 15:32:20.549733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 179/352] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:20 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:20.549967 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.551211 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:20.551829 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:20.552406 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:20.825860 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:20.852104 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-57a17865-303a-4308-88a1-4f4f6c616235 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.324057 Sep 13 15:32:20.857019 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 174/353] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:20 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:21.332063 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:21.333569 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:21.341410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:21.342795 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:21.345283 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:21.346285 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:21.346913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:21.347501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:21.397281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:21.398148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:21.398736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:21.399342 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lazy-loading 'fault' on Instance uuid 6a733f9c-072a-4d48-a807-423d74f654c3 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:32:21.480258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae72d51e9004670a50362d1206fab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b820ea465db4802aaa22dbaa4e7397a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:21.488623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dfae2530-7249-4d89-9d8e-0dd20522c7c2 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 200 len: 1303 microversion: 2.1 time: 0.160951 Sep 13 15:32:21.506856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 180/354] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:21 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:21.575601 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:21.577199 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:21.584301 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:21.585244 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:21.585893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:21.586925 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:21.587693 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:21.588736 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:21.845828 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:21.856322 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-3175b1c3-0e33-4d8f-a197-1d9ee136bc5b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1368 microversion: 2.1 time: 0.284439 Sep 13 15:32:21.857542 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 175/355] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:21 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:21.879420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:21.880035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:21.892585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:21.893121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:21.893565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:21.894343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:21.898068 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:21.898530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:22.152840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:22.161716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-285cb864-9de4-4d1a-8049-5296e0ab7966 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.287629 Sep 13 15:32:22.169416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 181/356] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:21 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:22.516105 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:22.516909 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] [instance: 6a733f9c-072a-4d48-a807-423d74f654c3] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:22.538384 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:22.538893 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:22.539376 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:22.540030 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:22.540575 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:22.541001 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:22.574009 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.wsgi [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] HTTP exception thrown: Instance 6a733f9c-072a-4d48-a807-423d74f654c3 could not be found. Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Request method failure captured: Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: request: GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 HTTP/1.1 Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept: application/json Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Accept-Encoding: identity Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Connection: close Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Length: 0 Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Content-Type: application/json Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Host: 10.222.0.16 Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Openstack-System-Scope: None Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: User-Agent: python-urllib3/1.26.12 Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Auth-Token: gAAAAABjIKIo1FC4xpJTcTH48IPw7AslsH484VP3G_s7ClXyLFsXzzksiEP5n2vwj1YeJb06Z8iFzvKEqdgDLRTVkgSVssjBu7s_Ks1JVU3tsJW-wNKpmeKxm-FTX9edkH6Moh1Sh5Ceb5NMrut6YXlbXafTqlXlrG54uQViln6kfrfi8zApVdo Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Id: None Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Domain-Name: None Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Identity-Status: Confirmed Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Is-Admin-Project: True Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Id: default Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Domain-Name: Default Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Id: 5b820ea465db4802aaa22dbaa4e7397a Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Project-Name: tempest-VolumesActionsTest-1621961704 Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Role: reader,member Sep 13 15:32:22.576263 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Roles: reader,member Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b820ea465db4802aaa22dbaa4e7397a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b820ea465db4802aaa22dbaa4e7397a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b820ea465db4802aaa22dbaa4e7397a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b820ea465db4802aaa22dbaa4e7397a"}]}] Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant: tempest-VolumesActionsTest-1621961704 Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Id: 5b820ea465db4802aaa22dbaa4e7397a Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-Tenant-Name: tempest-VolumesActionsTest-1621961704 Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User: tempest-VolumesActionsTest-1621961704-project Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Id: default Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Domain-Name: Default Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Id: 5ae72d51e9004670a50362d1206fab21 Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: X-User-Name: tempest-VolumesActionsTest-1621961704-project Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: method: > Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: exception: Instance 6a733f9c-072a-4d48-a807-423d74f654c3 could not be found. Sep 13 15:32:22.578671 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: action_args: {'id': '6a733f9c-072a-4d48-a807-423d74f654c3'} Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a733f9c-072a-4d48-a807-423d74f654c3 could not be found. Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:32:22.579564 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a733f9c-072a-4d48-a807-423d74f654c3 could not be found. Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a733f9c-072a-4d48-a807-423d74f654c3 could not be found. Sep 13 15:32:22.581083 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack.wsgi Sep 13 15:32:22.583298 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] Returning 404 to user: Instance 6a733f9c-072a-4d48-a807-423d74f654c3 could not be found. {{(pid=120659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:32:22.584314 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-55966e2b-8512-4711-b122-4f918bd12873 tempest-VolumesActionsTest-1621961704 tempest-VolumesActionsTest-1621961704-project] 10.222.0.16 "GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3" status: 404 len: 111 microversion: 2.1 time: 0.073431 Sep 13 15:32:22.585041 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 176/357] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:22 2022] GET /compute/v2.1/servers/6a733f9c-072a-4d48-a807-423d74f654c3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:32:22.880529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:22.881146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:22.885674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:22.896063 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:22.896882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:22.897433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:22.898465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:22.899196 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:22.899728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:23.194577 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:23.194577 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:23.220729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:23.232711 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:23.233257 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:23.233715 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:23.234484 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:23.243904 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:23.244437 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:23.250180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8124a851-72fa-4e16-b2ae-96c8e9235e25 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1558 microversion: 2.1 time: 0.367201 Sep 13 15:32:23.264551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 182/358] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:22 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1558 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:23.280448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:23.281099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:23.288586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:23.289262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:23.289844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:23.291231 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:23.292183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:23.293381 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:23.448612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cb0e3df7-c8ab-4e27-8518-25796118e669 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173624 Sep 13 15:32:23.449380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 183/359] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:32:23 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:23.671350 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:23.680607 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-72049737-ccba-4c3d-b538-ee2ec343ae29 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.491180 Sep 13 15:32:23.681483 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 177/360] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:23 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:24.712902 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:24.713551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:24.729696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:24.731122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:24.732046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:24.735284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:24.739537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:24.740450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:25.070153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:25.082952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c18b4f54-66b9-4351-b099-4f5acb144538 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.375481 Sep 13 15:32:25.083977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 184/361] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:24 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:25.277344 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-468fca0b-aa1f-4124-a507-807b68c40e9f req-037283ca-f0a6-4012-88b1-c27bc18fc2ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec25cef-3608-4af4-a0ff-119c601b2cb2", "tag": "bf95274d-7cad-4bd2-aa20-8fe6600a24ff"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:25.289127 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-468fca0b-aa1f-4124-a507-807b68c40e9f req-037283ca-f0a6-4012-88b1-c27bc18fc2ba service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:25.289835 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-468fca0b-aa1f-4124-a507-807b68c40e9f req-037283ca-f0a6-4012-88b1-c27bc18fc2ba service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:25.290499 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-468fca0b-aa1f-4124-a507-807b68c40e9f req-037283ca-f0a6-4012-88b1-c27bc18fc2ba service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:25.309222 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-468fca0b-aa1f-4124-a507-807b68c40e9f req-037283ca-f0a6-4012-88b1-c27bc18fc2ba service nova] Creating event network-changed:bf95274d-7cad-4bd2-aa20-8fe6600a24ff for instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 on hv-cinder-85743 Sep 13 15:32:25.319799 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-468fca0b-aa1f-4124-a507-807b68c40e9f req-037283ca-f0a6-4012-88b1-c27bc18fc2ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046007 Sep 13 15:32:25.323773 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 178/362] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:26.111232 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:26.111884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:26.118476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:26.119315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:26.120065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:26.120951 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:26.122273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:26.122848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:26.148258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:26.331738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:26.343164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5cfd7198-76ae-47a0-aee9-1ea979ddc178 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.236603 Sep 13 15:32:26.358150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 185/363] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:26 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:27.380663 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:27.381586 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:27.394859 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:27.398549 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:27.402166 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:27.403162 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:27.403823 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:27.404481 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:27.594769 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:27.607583 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-60f027ec-dfec-4830-bac7-298417dd8dc8 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.236451 Sep 13 15:32:27.608181 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 179/364] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:27 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:28.636443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:28.637222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:28.644619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:28.645354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:28.646073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:28.647330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:28.648029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:28.648606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:28.828336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:28.837955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-77cbb305-f9da-4086-bba5-ef5c758a29a6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.210051 Sep 13 15:32:28.839545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 186/365] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:28 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:29.865848 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:29.866502 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:29.877851 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:29.879628 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:29.880672 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:29.881319 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:29.882346 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:29.883045 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:29.883792 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:30.041578 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:30.053797 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-b21462cf-4994-42cb-99e7-c00ee678b5f6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.192212 Sep 13 15:32:30.054775 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 180/366] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:29 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:31.076973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:31.077670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:31.102838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:31.103393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:31.103844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:31.104591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:31.105051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:31.105481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:31.293392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:31.304268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4ac764e2-c6d5-4395-9b69-4b4c645d0c7d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1510 microversion: 2.1 time: 0.231122 Sep 13 15:32:31.305413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 187/367] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:31 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:32.328819 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:32.339423 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:32.352378 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:32.358144 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:32.358952 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:32.360557 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:32.361520 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:32.361944 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:32.573294 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:32.583883 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9e043c94-bb5e-4da3-a5cf-ed2aa5adf3df tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1516 microversion: 2.1 time: 0.259832 Sep 13 15:32:32.589178 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 181/368] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:32 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:34.502348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a9681d89-b3e8-4918-80af-e2befbde45ff tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Action: 'create', calling method: .version_select at 0x7f4bbf76fdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1608129216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHSF4KY14QMveylO9v7pblDW+fUfbZ/XqAe3TTR+Y6ZtPu4+N0G0YwGA6zsUgLzIZaiiJitGth1xcAYxgfLX0/IdGhx6g/d0PwgacWaV0eWViTBdaIfEyryWle5Lw2BAg=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:34.520207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-a9681d89-b3e8-4918-80af-e2befbde45ff tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Getting quotas for project 74318a6f074f4d7ea084461473ef1a80. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:32:34.524032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-a9681d89-b3e8-4918-80af-e2befbde45ff tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Getting quotas for user 0815b4e3389240ada8d1c55941aca8cf and project 74318a6f074f4d7ea084461473ef1a80. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:32:34.549654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a9681d89-b3e8-4918-80af-e2befbde45ff tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051191 Sep 13 15:32:34.550287 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 188/369] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:32:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:32:34.678486 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1162116228", "imageRef": "d79c15c7-7745-4670-be6c-ddeabf44161f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1608129216", "networks": [{"uuid": "4897ec02-d766-460e-a83c-485c4f81bdfd"}]}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:35.205656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-70635814-725c-4285-8374-cf1396cd5668 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'create', calling method: .version_select at 0x7f4bbf64a4c0>, body: {"keypair": {"name": "tempest-keypair-749516263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6bulaZ1bfK/sjZIh0A6DLTB8R5oZf4i9/i0LiKtPVy7++SKGEggD/5tGCOuSamOjLP8K5f9jfHr4cMLeLSjTxk5GOCQ11rCC1eQDsBKHZkgHaVIEC+yYMYRmSJwon9pA=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:35.221606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-70635814-725c-4285-8374-cf1396cd5668 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:32:35.225409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-70635814-725c-4285-8374-cf1396cd5668 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for user 97189d5c87c94be2bef7cff79c471c7d and project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:32:35.251332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-70635814-725c-4285-8374-cf1396cd5668 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049778 Sep 13 15:32:35.251927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 189/370] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:32:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:36.812793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1852856421", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "727aeb83-9e0c-4e35-a2e7-ffb5dc5e6a50"}], "security_groups": [{"name": "tempest-securitygroup--520652506"}], "key_name": "tempest-keypair-749516263", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:41.299241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=14 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:42.434326 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.network.neutron [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] validate_networks() for [('4897ec02-d766-460e-a83c-485c4f81bdfd', None, None, None, None, None)] {{(pid=120659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:32:42.569551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] validate_networks() for [('727aeb83-9e0c-4e35-a2e7-ffb5dc5e6a50', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:32:42.578381 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:43.281780 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Flavor limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:32:43.282447 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Image limits 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:32:43.283079 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Flavor pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:32:43.283667 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Image pref 0:0:0 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:32:43.284053 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.virt.hardware [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:32:43.298432 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:32:43.298852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:32:43.299357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:32:43.299746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:32:43.300158 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:32:43.303773 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:43.304297 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:43.304710 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:43.305745 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:43.306406 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:43.306973 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:43.311470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:43.312067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:43.313329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:43.314636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:43.315172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:43.315714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:43.328351 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Getting quotas for project 74318a6f074f4d7ea084461473ef1a80. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:32:43.335318 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.quota [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Getting quotas for user 0815b4e3389240ada8d1c55941aca8cf and project 74318a6f074f4d7ea084461473ef1a80. Resources: {'instances', 'ram', 'cores'} {{(pid=120659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:32:43.337341 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:32:43.341837 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Getting quotas for user 97189d5c87c94be2bef7cff79c471c7d and project 07f8e7ebb2814be392842c2e17d55fca. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:32:43.356264 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Going to run 1 instances... {{(pid=120659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:32:43.357049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:32:43.360295 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d79c15c7-7745-4670-be6c-ddeabf44161f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:32:43.361071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:32:43.432399 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-93a432bd-04c7-44d4-9d95-b46bb89626f1 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.757517 Sep 13 15:32:43.433942 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 182/371] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 8760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:32:43.440665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-096ff2bc-3d8e-4f3c-87e2-e2713fb22031 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.632754 Sep 13 15:32:43.446597 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-802cd4b4-d25d-416f-aec1-9f2af75a8088 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:43.447277 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-802cd4b4-d25d-416f-aec1-9f2af75a8088 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:43.451152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 190/372] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:32:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 6644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:32:43.468671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d2d501eb-b7d9-4262-8fcd-4e6cb509ddea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:43.469372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d2d501eb-b7d9-4262-8fcd-4e6cb509ddea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:43.544766 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-802cd4b4-d25d-416f-aec1-9f2af75a8088 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:43.556414 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-802cd4b4-d25d-416f-aec1-9f2af75a8088 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1259 microversion: 2.1 time: 0.114283 Sep 13 15:32:43.558667 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 183/373] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:43 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1259 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:43.574832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d2d501eb-b7d9-4262-8fcd-4e6cb509ddea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:43.582859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d2d501eb-b7d9-4262-8fcd-4e6cb509ddea tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1245 microversion: 2.1 time: 0.118798 Sep 13 15:32:43.595168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 191/374] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:43 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:44.580917 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:44.582902 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:44.589186 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:44.589929 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:44.590586 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:44.591460 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:44.592093 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:44.592875 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:44.607620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:44.608957 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:44.616562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:44.617373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:44.618053 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:44.618773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:44.619395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:44.619817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:44.671192 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:44.679982 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-29aa892a-6d63-4f16-95be-503b3b5aab69 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1255 microversion: 2.1 time: 0.102399 Sep 13 15:32:44.681333 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 184/375] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:44 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1255 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:44.726511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:44.735044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-96d2c902-3688-47eb-9656-93df81426f88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1297 microversion: 2.1 time: 0.131255 Sep 13 15:32:44.735608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 192/376] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:44 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1297 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:45.705061 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:45.705761 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:45.719688 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:45.720424 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:45.720856 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:45.722352 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:45.722971 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:45.723653 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:45.759729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:45.761124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:45.779387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:45.782142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:45.782906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:45.784483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:45.785271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:45.786085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:45.792170 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:45.800866 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f5c91479-f957-4fc2-98a9-48809b6dff7c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1311 microversion: 2.1 time: 0.099744 Sep 13 15:32:45.801874 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 185/377] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:45 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:45.877292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:45.894760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eb11e54b-5444-41ee-9009-cf00b318a190 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1303 microversion: 2.1 time: 0.140064 Sep 13 15:32:45.903388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 193/378] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:45 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:46.827742 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:46.829130 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:46.849747 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:46.853985 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:46.855204 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:46.861916 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:46.862915 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:46.865216 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:46.924661 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:46.925909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:46.939496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:46.943309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:46.943977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:46.946731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:46.947477 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:46.949968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:47.274799 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:47.290926 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9663b95d-3caf-4598-9783-4bb15f9ef88e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1317 microversion: 2.1 time: 0.467175 Sep 13 15:32:47.292063 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 186/379] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:46 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:47.387599 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:47.400001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-89e98941-275e-41c6-9776-3183207d6c72 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.478619 Sep 13 15:32:47.402222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 194/380] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:46 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:47.592038 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [req-9bc5d927-6a98-4794-ad6f-4ffef2a656ea req-ea84cb7c-4b7c-4e1a-a9aa-30041a003736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0782cb8b-a07b-4d5c-8014-23397c7d38c1", "tag": "a5830845-c6ca-471c-ae1c-f8508ae26cc3"}]} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:47.614613 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-9bc5d927-6a98-4794-ad6f-4ffef2a656ea req-ea84cb7c-4b7c-4e1a-a9aa-30041a003736 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:47.620355 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-9bc5d927-6a98-4794-ad6f-4ffef2a656ea req-ea84cb7c-4b7c-4e1a-a9aa-30041a003736 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:47.620897 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [req-9bc5d927-6a98-4794-ad6f-4ffef2a656ea req-ea84cb7c-4b7c-4e1a-a9aa-30041a003736 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:47.678324 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.compute.server_external_events [req-9bc5d927-6a98-4794-ad6f-4ffef2a656ea req-ea84cb7c-4b7c-4e1a-a9aa-30041a003736 service nova] Creating event network-changed:a5830845-c6ca-471c-ae1c-f8508ae26cc3 for instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 on hv-cinder-85743 Sep 13 15:32:47.684951 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [req-9bc5d927-6a98-4794-ad6f-4ffef2a656ea req-ea84cb7c-4b7c-4e1a-a9aa-30041a003736 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096562 Sep 13 15:32:47.685953 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 187/381] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:32:48.318419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:48.319145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:48.326755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:48.327565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:48.328058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:48.329221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:48.329853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:48.330498 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:48.429818 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:48.431076 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:48.443064 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:48.443662 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:48.444464 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:48.447070 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:48.447624 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:48.449825 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:48.532396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:48.542604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5acade7c-2678-4426-a973-bb65a93ce9b2 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.227464 Sep 13 15:32:48.545605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 195/382] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:48 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:48.775192 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:48.788611 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-76c63b75-3946-4ccf-aa1c-4d9dbcfa0f54 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.363254 Sep 13 15:32:48.789203 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 188/383] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:48 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:49.573208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:49.574751 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:49.590847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:49.595079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:49.598203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:49.600231 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:49.602007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:49.602764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:49.815015 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:49.815619 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:49.827013 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:49.827420 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:49.827856 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:49.828568 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:49.829023 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:49.829510 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:50.089916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:50.101326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b71098d0-a727-41bb-8f06-401ed77199a8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.533134 Sep 13 15:32:50.113471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 196/384] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:49 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:50.182973 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:50.196214 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-1a95a56d-a965-4d4d-b11b-f95f71b945de tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.384888 Sep 13 15:32:50.206943 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 189/385] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:49 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:51.140400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:51.142168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:51.144832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:51.151062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:51.151941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:51.152378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:51.153084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:51.153563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:51.153985 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:51.225616 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:51.227028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:51.243717 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:51.244476 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:51.244980 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:51.246071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:51.246666 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:51.247189 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:51.484486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:51.500387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2f19a202-4668-4296-ad2a-e429d4040996 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.363931 Sep 13 15:32:51.515544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 197/386] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:51 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:51.573929 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:51.582465 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-c90a5cd6-c082-4fd1-9749-9e6a77c6ca9c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.361410 Sep 13 15:32:51.583427 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 190/387] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:51 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:52.525904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:52.527357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:52.534347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:52.534915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:52.535622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:52.536728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:52.537267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:52.537901 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:52.609308 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:52.609977 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:52.631874 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:52.632762 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:52.633550 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:52.634508 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:52.635148 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:52.635769 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:52.774753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:52.792597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6921a4c7-9ac5-471d-83c7-9cd3d3c61303 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.270617 Sep 13 15:32:52.808974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 198/388] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:52 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:52.828735 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:52.840715 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-f1a71043-db23-4d90-8a3a-e3b75b336d67 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.235282 Sep 13 15:32:52.842799 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 191/389] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:52 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:53.816205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:53.816817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:53.818929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:53.821920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=16 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:53.827492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:53.827989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:53.828428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:53.829200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:53.829659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:53.830086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:53.865380 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:53.867213 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:53.869724 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=2 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:53.870659 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell0:SELECT=8 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:32:53.883537 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:53.884340 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:53.885515 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:53.887461 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:53.891252 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:53.891910 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:54.115725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:54.125780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-58219e96-122f-459c-ae47-838fe5805908 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.314065 Sep 13 15:32:54.128490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 199/390] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:53 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:54.282914 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:54.300994 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-9e2dfb9c-8578-4df2-a70a-5a8189a65a4d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.439234 Sep 13 15:32:54.319193 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 192/391] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:53 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:55.154720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:55.156051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:55.163616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:55.164131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:55.164686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:55.165435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:55.165878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:55.166319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:55.325411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:55.332811 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:55.333998 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.compute.api [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120659) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:55.345140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-947f01e2-c228-49ff-b4b0-9c9e5a5238d9 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.196534 Sep 13 15:32:55.348158 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:55.348587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 200/392] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:55 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:55.349227 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:55.349806 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:55.351156 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:55.351841 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:55.352395 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG oslo_concurrency.lockutils [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:55.536619 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.policy [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120659) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:55.545690 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-d89f091f-cf75-4184-94b4-ba73fef3ade0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.216608 Sep 13 15:32:55.567163 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 193/393] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:55 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:56.373098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:56.373850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:56.383827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:56.385029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:56.385573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:56.386398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:56.387075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:56.387715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:56.425520 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1600540449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-806206350", "security_groups": [{"name": "tempest-secgroup-smoke-1359888796"}], "block_device_mapping_v2": [{"uuid": "a7e8dcfe-be8f-4a57-850f-31a7be62fe16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7851da04-1684-4f7c-8bef-bacba413f66a"}]}} {{(pid=120659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:32:56.611001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:56.620314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e61a7476-50e7-44c8-ba88-a14616bfd337 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.251132 Sep 13 15:32:56.634434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 201/394] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:56 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:56.637000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:56.637610 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:56.664185 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.network.neutron [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] validate_networks() for [('7851da04-1684-4f7c-8bef-bacba413f66a', None, None, None, None, None)] {{(pid=120659) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:32:56.664964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:56.665712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:56.666354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:56.671138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:56.671794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:56.672361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:56.831463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:56.840765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-71826a9c-227c-436e-a6f0-5319effb7fde tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.207572 Sep 13 15:32:56.841795 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 202/395] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:56 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:57.650259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:57.651605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:57.662149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:57.662992 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:57.663588 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:57.664453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:57.665238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:57.665963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:57.911989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:57.926213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ff84d0e0-3bb6-42b8-a591-73992d361459 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.277414 Sep 13 15:32:57.927535 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 203/396] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:57 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:57.950132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:57.955139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:57.961222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:57.965435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:57.965435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:57.965435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:57.965435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:57.965909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:58.172117 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:58.183147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b4dc71d8-06a7-4480-a243-f4a72e859d9e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.253884 Sep 13 15:32:58.184092 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 204/397] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:57 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:32:58.964980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:58.965689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:58.972255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:58.972704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:58.973181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:58.973867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:58.974328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:58.974761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:59.119090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:59.126894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c635a4a9-b53b-4e7f-89a7-ac6621394311 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.165857 Sep 13 15:32:59.127485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 205/398] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:58 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:32:59.210758 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:32:59.211284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:32:59.218042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:59.218542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:59.218986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:59.219683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:32:59.220141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:32:59.220566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:32:59.362934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:32:59.371315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1b1afb21-c5bf-4dde-b9ec-0ed819229923 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.166368 Sep 13 15:32:59.372110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 206/399] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:32:59 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:00.150727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:00.151398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:00.158072 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:00.158595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:00.159028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:00.159721 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:00.160175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:00.160596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:00.309608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:00.319223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-177824c3-d3e1-4470-8429-95cb834d29b7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.172733 Sep 13 15:33:00.319882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 207/400] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:00 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:00.394153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:00.394785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:00.401308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:00.401799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:00.402256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:00.403188 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:00.403942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:00.404698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:00.409466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:00.557314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:00.565061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-921143bb-a00e-496a-a38c-c2fe1d82122d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.174782 Sep 13 15:33:00.565637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 208/401] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:00 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:01.344324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:01.345014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:01.352129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:01.352639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:01.353076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:01.353783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:01.354275 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:01.354704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:01.497192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:01.505334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-14cb0122-8d58-4a7b-b41d-9b29dc1f5afe tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.165390 Sep 13 15:33:01.505922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 209/402] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:01 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:01.588208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:01.588906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:01.595964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:01.596398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:01.596816 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:01.597516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:01.598237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:01.598632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:01.754388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:01.762487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fb8cea9c-a93f-4549-bf2d-e852cf853ab0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.178230 Sep 13 15:33:01.763073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 210/403] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:01 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:02.528912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:02.529564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:02.536235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:02.536718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:02.537143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:02.537831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:02.538423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:02.538872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:02.672490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:02.680717 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9d689935-069f-4780-8bea-730eb8f23eb0 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.155874 Sep 13 15:33:02.681375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 211/404] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:02 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:02.786202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:02.786818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:02.793000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:02.793510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:02.793923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:02.794657 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:02.795113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:02.795533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:02.928033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:02.935799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d15c1c2-6925-46a4-8d3c-1b60d118aaae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.154137 Sep 13 15:33:02.946138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 212/405] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:02 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:03.704059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:03.704747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:03.711624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:03.712114 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:03.712539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:03.713226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:03.713700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:03.714142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:03.847663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:03.859292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-89ac1889-3238-4a16-80c0-9796cb28f6d8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.158882 Sep 13 15:33:03.860131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 213/406] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:03 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:03.962842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:03.963462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:03.971314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:03.971886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:03.972393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:03.973202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:03.973731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:03.974273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:04.115095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:04.127182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2c91b608-befb-4a52-8a71-e1eec4d2df17 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.170117 Sep 13 15:33:04.128022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 214/407] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:03 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:04.882656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:04.883337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:04.889799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:04.890325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:04.890752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:04.891443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:04.891881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:04.892298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:05.098607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:05.107298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-844ad945-3bf5-4578-9b46-ef566b1355c5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.228434 Sep 13 15:33:05.108279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 215/408] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:04 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:05.135127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-723384f2-8acb-431d-9df7-c4725b599af8 req-ab523ea0-082f-430a-b4cf-d80639943e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b061df6a-e663-49b1-baec-e555aa59534c", "tag": "ac7865ed-3013-45da-bc75-391a25c58cca"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:05.146506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-723384f2-8acb-431d-9df7-c4725b599af8 req-ab523ea0-082f-430a-b4cf-d80639943e58 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:05.146986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-723384f2-8acb-431d-9df7-c4725b599af8 req-ab523ea0-082f-430a-b4cf-d80639943e58 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:05.147607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-723384f2-8acb-431d-9df7-c4725b599af8 req-ab523ea0-082f-430a-b4cf-d80639943e58 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:05.161593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-723384f2-8acb-431d-9df7-c4725b599af8 req-ab523ea0-082f-430a-b4cf-d80639943e58 service nova] Creating event network-changed:ac7865ed-3013-45da-bc75-391a25c58cca for instance b061df6a-e663-49b1-baec-e555aa59534c on hv-cinder-85743 Sep 13 15:33:05.166711 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-723384f2-8acb-431d-9df7-c4725b599af8 req-ab523ea0-082f-430a-b4cf-d80639943e58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035330 Sep 13 15:33:05.167257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 216/409] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:05.172363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:05.173050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:05.179512 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:05.179993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:05.180437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:05.181137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:05.181582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:05.181998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:05.315517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:05.323443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cd83e770-db22-477d-bf08-53143d2d1ba0 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.155046 Sep 13 15:33:05.323976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 217/410] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:05 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:05.541492 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_cell1:SELECT=58 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:06.133547 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:06.134460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:06.141684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:06.142198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:06.142636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:06.143331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:06.143786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:06.144211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:06.276580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:06.284860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7e5ff071-8046-45ee-bad4-a2f89077e93a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.156546 Sep 13 15:33:06.285433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 218/411] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:06 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:06.359677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:06.360728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:06.370583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:06.371067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:06.371508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:06.372208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:06.372686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:06.373097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:06.454546 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG dbcounter [-] [120659] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:06.506222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:06.513939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-29dc5697-4e74-4699-a807-8215aad22a87 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.160819 Sep 13 15:33:06.514553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 219/412] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:06 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:07.316939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:07.317746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:07.325492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:07.325978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:07.326447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:07.327142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:07.327590 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:07.328040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:07.463536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:07.472496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-90470823-fa15-4b29-b641-de2d6ca2be0f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.160995 Sep 13 15:33:07.473068 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 220/413] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:07 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:07.536689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:07.537294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:07.543483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:07.543971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:07.544378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:07.545101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:07.545550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:07.545973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:07.688716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:07.700102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-01e6bc49-9e8c-4eaf-8b21-6f2f94aaf2fc tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.167094 Sep 13 15:33:07.700695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 221/414] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:07 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:08.498639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:08.499297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:08.506141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:08.506648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:08.507084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:08.507781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:08.508237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:08.508728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:08.654282 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:08.662540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0862a78b-f210-4359-ae0a-2fee0ce7ab22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.168696 Sep 13 15:33:08.663098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 222/415] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:08 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:08.727834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:08.728836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:08.739004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:08.739822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:08.740544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:08.741697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:08.742517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:08.743277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:08.882539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:08.891348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-78b1629b-d408-4ea4-a2a9-dfc587b41cfd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.169972 Sep 13 15:33:08.892002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 223/416] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:08 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:09.688726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:09.689695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:09.699389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:09.699870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:09.700303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:09.700993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:09.701446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:09.701870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:09.832444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:09.840376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-96bf0a48-709a-4845-9d0e-79b1de47cc0e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.158098 Sep 13 15:33:09.840989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 224/417] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:09 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:09.918418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:09.918989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:09.925876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:09.926459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:09.926933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:09.927693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:09.928193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:09.928664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:09.949057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:10.083521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:10.092430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b7d724b6-01e4-4c7b-a912-6610ae4bf6e2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.180655 Sep 13 15:33:10.092997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 225/418] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:09 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:10.870210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:10.871123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:10.877544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:10.878022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:10.878473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:10.879156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:10.879598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:10.880014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:11.019677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:11.028589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a922ab3d-4cb8-404f-9f27-a5bebeb39101 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.166690 Sep 13 15:33:11.029152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 226/419] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:10 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:11.116107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:11.117083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:11.123684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:11.124496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:11.125188 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:11.125964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:11.126679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:11.127315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:11.350969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:11.365797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d8c9c891-ca53-444d-a2aa-b9fff2744c41 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.253566 Sep 13 15:33:11.370156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 227/420] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:11 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:11.443254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-7668138d-d43d-4f14-bc9a-4a687e67b408 req-12cb1e01-352b-4619-9369-7f720103f843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0782cb8b-a07b-4d5c-8014-23397c7d38c1", "name": "network-vif-plugged", "status": "completed", "tag": "a5830845-c6ca-471c-ae1c-f8508ae26cc3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:11.455559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7668138d-d43d-4f14-bc9a-4a687e67b408 req-12cb1e01-352b-4619-9369-7f720103f843 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:11.456815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7668138d-d43d-4f14-bc9a-4a687e67b408 req-12cb1e01-352b-4619-9369-7f720103f843 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:11.457233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7668138d-d43d-4f14-bc9a-4a687e67b408 req-12cb1e01-352b-4619-9369-7f720103f843 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:11.471826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-7668138d-d43d-4f14-bc9a-4a687e67b408 req-12cb1e01-352b-4619-9369-7f720103f843 service nova] Creating event network-vif-plugged:a5830845-c6ca-471c-ae1c-f8508ae26cc3 for instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 on hv-cinder-85743 Sep 13 15:33:11.477307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-7668138d-d43d-4f14-bc9a-4a687e67b408 req-12cb1e01-352b-4619-9369-7f720103f843 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038774 Sep 13 15:33:11.477967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 228/421] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:33:12.053423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:12.054220 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:12.060742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:12.061233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:12.061669 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:12.062404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:12.063022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:12.063452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:12.208759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:12.218560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a9dc8514-3b0d-4ba2-9623-06352b3e4ad7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.169988 Sep 13 15:33:12.219135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 229/422] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:12 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:12.393205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:12.394086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:12.404250 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:12.404739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:12.405342 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:12.406045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:12.406527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:12.406946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:12.545724 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:12.553940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ab0793be-bc0a-488a-b50e-9eb98ab0214a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.167165 Sep 13 15:33:12.554437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 230/423] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:12 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:13.242112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:13.242790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:13.249960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:13.250417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:13.250848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:13.251632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:13.252018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:13.253032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:13.386044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:13.394693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dd30c28b-ffc2-4cdf-a5d1-89a1275b5854 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.156530 Sep 13 15:33:13.395264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 231/424] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:13 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:13.493860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-588b29e4-19f2-4b0f-85c2-d1bf462358fc req-dfde3750-f795-45a2-8337-15e2290ffa04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b061df6a-e663-49b1-baec-e555aa59534c", "name": "network-vif-plugged", "status": "completed", "tag": "ac7865ed-3013-45da-bc75-391a25c58cca"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:13.503487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-588b29e4-19f2-4b0f-85c2-d1bf462358fc req-dfde3750-f795-45a2-8337-15e2290ffa04 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:13.503992 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-588b29e4-19f2-4b0f-85c2-d1bf462358fc req-dfde3750-f795-45a2-8337-15e2290ffa04 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:13.504464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-588b29e4-19f2-4b0f-85c2-d1bf462358fc req-dfde3750-f795-45a2-8337-15e2290ffa04 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:13.515553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-588b29e4-19f2-4b0f-85c2-d1bf462358fc req-dfde3750-f795-45a2-8337-15e2290ffa04 service nova] Creating event network-vif-plugged:ac7865ed-3013-45da-bc75-391a25c58cca for instance b061df6a-e663-49b1-baec-e555aa59534c on hv-cinder-85743 Sep 13 15:33:13.520313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-588b29e4-19f2-4b0f-85c2-d1bf462358fc req-dfde3750-f795-45a2-8337-15e2290ffa04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030180 Sep 13 15:33:13.520869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 232/425] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:13.577034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:13.577656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:13.584360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:13.584844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:13.585278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:13.585972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:13.586487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:13.586892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:13.734222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:13.741961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c79ea25a-9eb9-44b9-b7d3-47c9dd8f7417 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1370 microversion: 2.1 time: 0.169283 Sep 13 15:33:13.742537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 233/426] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:13 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:14.419007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:14.420442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:14.428201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:14.428691 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:14.429122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:14.429822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:14.430305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:14.430726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:14.565581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:14.574018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ffe4ba49-f22e-4121-8ee1-b226fcf9a08d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.159640 Sep 13 15:33:14.574692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 234/427] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:14 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:14.769109 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:14.770028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:14.778589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:14.779078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:14.779516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:14.780211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:14.780666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:14.781090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:14.924104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:14.932461 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7a3cac78-b695-4cf5-b4d6-4274cd4fc36e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1563 microversion: 2.1 time: 0.170028 Sep 13 15:33:14.933027 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 235/428] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:14 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:14.955770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:14.956259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:14.962638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:14.963395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:14.964026 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:14.964739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:14.965204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:14.965629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:15.045855 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cda143cd-d0da-42eb-b5b1-075f08564008 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093756 Sep 13 15:33:15.046687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 236/429] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:33:14 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:15.598240 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:15.598903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:15.605424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:15.606011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:15.606472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:15.607187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:15.607625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:15.608052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:15.746761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:15.754360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c86dd808-d87f-42dc-a1f8-f72ea1598745 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1359 microversion: 2.1 time: 0.160701 Sep 13 15:33:15.754910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 237/430] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:15 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:16.292263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-883015db-e0fe-4f40-8e91-0724276d61d6 req-c69b047d-0fa5-4d65-85d1-21a8a6e2e054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0782cb8b-a07b-4d5c-8014-23397c7d38c1", "tag": "a5830845-c6ca-471c-ae1c-f8508ae26cc3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:16.304755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-883015db-e0fe-4f40-8e91-0724276d61d6 req-c69b047d-0fa5-4d65-85d1-21a8a6e2e054 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:16.305237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-883015db-e0fe-4f40-8e91-0724276d61d6 req-c69b047d-0fa5-4d65-85d1-21a8a6e2e054 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:16.305666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-883015db-e0fe-4f40-8e91-0724276d61d6 req-c69b047d-0fa5-4d65-85d1-21a8a6e2e054 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:16.316997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-883015db-e0fe-4f40-8e91-0724276d61d6 req-c69b047d-0fa5-4d65-85d1-21a8a6e2e054 service nova] Creating event network-changed:a5830845-c6ca-471c-ae1c-f8508ae26cc3 for instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 on hv-cinder-85743 Sep 13 15:33:16.322140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-883015db-e0fe-4f40-8e91-0724276d61d6 req-c69b047d-0fa5-4d65-85d1-21a8a6e2e054 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033609 Sep 13 15:33:16.322904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 238/431] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:16.777441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:16.778398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:16.785433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:16.785991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:16.786503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:16.787202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:16.787651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:16.788072 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:16.927472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:16.935830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4361d0ff-b120-4a4a-b3e2-fd7e010ace53 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1548 microversion: 2.1 time: 0.162569 Sep 13 15:33:16.936544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 239/432] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:16 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:16.961219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:16.961827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:16.968337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:16.968829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:16.969258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:16.970226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:16.970648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:16.971072 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:17.104866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:17.113896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5409ec9b-8ca8-4d09-8f0d-c139c5652446 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1548 microversion: 2.1 time: 0.156382 Sep 13 15:33:17.114436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 240/433] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:16 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:17.136073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:17.141067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:17.141831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Searching by: {'deleted': False, 'project_id': '74318a6f074f4d7ea084461473ef1a80'} {{(pid=120658) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 15:33:17.148920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:17.149622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:17.150051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:17.151127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:17.151257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:17.151632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:17.246314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.multi_cell_list [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120658) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 15:33:17.346757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-27d25ccc-0b3c-4334-825e-e4f01a655d66 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214846 Sep 13 15:33:17.347351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 241/434] 10.222.0.16 () {58 vars in 1125 bytes} [Tue Sep 13 15:33:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:33:17.359821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:17.360447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:17.366847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:17.367449 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:17.367892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:17.368596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:17.369046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:17.369467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:17.502564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:17.511834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-94a7829c-f9ce-46db-8e69-609f94adc622 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1548 microversion: 2.1 time: 0.156628 Sep 13 15:33:17.512602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 242/435] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:17 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:18.712719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:18.713371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:18.720500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:18.720988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:18.721431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:18.722139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:18.722630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:18.723057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:18.747242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0783b0a2-0d17-4928-9126-a603e566f8a4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/ips" status: 200 len: 145 microversion: 2.1 time: 0.038317 Sep 13 15:33:18.747703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 243/436] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:33:18 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:19.109905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1cae36e-e01c-4b31-81fb-a750e2127092"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:19.113524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:19.122859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:19.123351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:19.123790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:19.124488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:19.124942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:19.125369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:19.142295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:19.387407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6b952907-a309-459a-a71f-2a60a81a7ff8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284025 Sep 13 15:33:19.388012 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 244/437] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:33:19 2022] POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:22.112303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c509fe7e-8bac-488f-a927-2378a8887c3d"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:22.115942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:22.118715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=96 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:22.125430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:22.125907 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:22.126393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:22.127081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:22.127527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:22.127975 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:22.405123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0b876c8f-d816-47db-931f-f78ae4f10ab0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300528 Sep 13 15:33:22.405757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 245/438] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:33:22 2022] POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:23.528950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:23.529545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:23.536017 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:23.536509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:23.536942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:23.537634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:23.538084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:23.538556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:23.562526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8de8110a-94b6-4eba-91d9-be98e729aa5f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/ips" status: 200 len: 152 microversion: 2.20 time: 0.038293 Sep 13 15:33:23.563131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 246/439] 10.222.0.16 () {60 vars in 1289 bytes} [Tue Sep 13 15:33:23 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:33:25.673690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:25.674582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:25.681745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:25.682256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:25.682683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:25.683365 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:25.683807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:25.684279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:25.709486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lazy-loading 'flavor' on Instance uuid 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:33:25.905236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3c3768cc-c308-4661-b566-b5397d4c146a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/action" status: 202 len: 0 microversion: 2.20 time: 0.235493 Sep 13 15:33:25.906059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 247/440] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 13 15:33:25 2022] POST /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 15:33:25.914488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:25.915208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:25.921595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:25.922153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:25.922615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:25.923296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:25.923746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:25.924163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:26.062828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:26.071687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:26.073125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:26.074334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8ebdb88f-0e04-4e60-a4b1-ca635aa2b1c2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.163823 Sep 13 15:33:26.074915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 248/441] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:25 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:33:27.031932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:27.032552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:27.039441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:27.039926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:27.040360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:27.041055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:27.041508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:27.041930 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:27.176018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:27.182384 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:27.185278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ad68143c-4e94-4cb3-ac61-eeecab0d9015 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1594 microversion: 2.1 time: 0.157181 Sep 13 15:33:27.185841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 249/442] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:27 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:27.191095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:27.191685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:27.197390 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:27.197864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:27.198324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:27.199071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:27.199518 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:27.199932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:27.339230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:27.348420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:27.349879 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:27.351047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-473290cc-9f30-40c0-a844-9e125d629b9d tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.164281 Sep 13 15:33:27.351592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 250/443] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:27 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:28.377263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:28.377951 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:28.384954 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:28.385450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:28.385882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:28.386631 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:28.387082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:28.387509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:28.729051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:28.737690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:28.739141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:28.740300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bbb4e4fa-cc31-4ba2-a905-52dba05c5aa3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.367949 Sep 13 15:33:28.740860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 251/444] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:28 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:29.471637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-4155c8d7-b9c9-499c-a3ab-3f3b960c22d6 req-f7e7fa1f-c27c-4d41-88aa-86771496c9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b061df6a-e663-49b1-baec-e555aa59534c", "tag": "ac7865ed-3013-45da-bc75-391a25c58cca"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:29.481884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4155c8d7-b9c9-499c-a3ab-3f3b960c22d6 req-f7e7fa1f-c27c-4d41-88aa-86771496c9d7 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:29.482385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4155c8d7-b9c9-499c-a3ab-3f3b960c22d6 req-f7e7fa1f-c27c-4d41-88aa-86771496c9d7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:29.482793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4155c8d7-b9c9-499c-a3ab-3f3b960c22d6 req-f7e7fa1f-c27c-4d41-88aa-86771496c9d7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:29.496156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-4155c8d7-b9c9-499c-a3ab-3f3b960c22d6 req-f7e7fa1f-c27c-4d41-88aa-86771496c9d7 service nova] Creating event network-changed:ac7865ed-3013-45da-bc75-391a25c58cca for instance b061df6a-e663-49b1-baec-e555aa59534c on hv-cinder-85743 Sep 13 15:33:29.501431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-4155c8d7-b9c9-499c-a3ab-3f3b960c22d6 req-f7e7fa1f-c27c-4d41-88aa-86771496c9d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035048 Sep 13 15:33:29.508075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 252/445] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:29.766479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:29.767488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:29.773875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:29.774664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:29.775522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:29.776455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:29.777123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:29.777961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:30.009937 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:30.030401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:30.034495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:30.036117 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2dffad87-3fb7-43d3-b21e-355fc04e3b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.274030 Sep 13 15:33:30.036926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 253/446] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:29 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:30.647874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-311192734"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:30.648438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:30.654930 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:30.655447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:30.655882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:30.656575 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:30.657030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:30.657636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:30.800881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.network.security_group_api [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Adding security group 2629fab4-a835-4c4c-8f72-0dd82071acbd to port ac7865ed-3013-45da-bc75-391a25c58cca Sep 13 15:33:31.137084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eaafa377-058d-4c82-b155-fc3fca81b721 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/action" status: 202 len: 0 microversion: 2.1 time: 0.493114 Sep 13 15:33:31.137755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 254/447] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:33:30 2022] POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:33:31.142658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:31.143486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:31.150340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:31.150981 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:31.151656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:31.152665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:31.153732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:31.154514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:31.292853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:31.301911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:31.303515 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:31.304920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-37ef25fb-edeb-4949-808e-7b6cd9f40b6b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.166059 Sep 13 15:33:31.305675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 255/448] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:31 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:31.327627 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:31.328247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:31.334308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:31.334842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:31.335271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:31.335956 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:31.336413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:31.336836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:31.496206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:31.505376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1a6d3c08-0475-41f7-9c17-e872458f8032 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1759 microversion: 2.1 time: 0.181589 Sep 13 15:33:31.505936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 256/449] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:31 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:31.518528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-2bc12322-ec02-434e-8a36-35f74d407160 req-4d3dd0de-d9d7-4e44-9265-f63e2d747d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b061df6a-e663-49b1-baec-e555aa59534c", "tag": "ac7865ed-3013-45da-bc75-391a25c58cca"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:31.528530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2bc12322-ec02-434e-8a36-35f74d407160 req-4d3dd0de-d9d7-4e44-9265-f63e2d747d4e service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:31.529007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2bc12322-ec02-434e-8a36-35f74d407160 req-4d3dd0de-d9d7-4e44-9265-f63e2d747d4e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:31.529428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2bc12322-ec02-434e-8a36-35f74d407160 req-4d3dd0de-d9d7-4e44-9265-f63e2d747d4e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:31.541273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-2bc12322-ec02-434e-8a36-35f74d407160 req-4d3dd0de-d9d7-4e44-9265-f63e2d747d4e service nova] Creating event network-changed:ac7865ed-3013-45da-bc75-391a25c58cca for instance b061df6a-e663-49b1-baec-e555aa59534c on hv-cinder-85743 Sep 13 15:33:31.546764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-2bc12322-ec02-434e-8a36-35f74d407160 req-4d3dd0de-d9d7-4e44-9265-f63e2d747d4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032030 Sep 13 15:33:31.547366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 257/450] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:32.337504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:32.338605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:32.347247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:32.347736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:32.348168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:32.348861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:32.349314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:32.349734 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:32.367782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:32.486647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:32.494752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:32.496182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:32.497334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-682156c8-f3a9-47fb-bdc1-614fbf13b994 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.168064 Sep 13 15:33:32.497886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 258/451] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:32 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:32.929493 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:33:32.930140 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:33:33.176020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3130e7a9-df87-47dd-8604-c82733b3bc9c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:33.182184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3130e7a9-df87-47dd-8604-c82733b3bc9c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:33.182637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3130e7a9-df87-47dd-8604-c82733b3bc9c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:33.183073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3130e7a9-df87-47dd-8604-c82733b3bc9c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:33.244317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3130e7a9-df87-47dd-8604-c82733b3bc9c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Going to try to stop instance {{(pid=120658) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 15:33:33.292752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3130e7a9-df87-47dd-8604-c82733b3bc9c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.120998 Sep 13 15:33:33.293362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 259/452] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:33:33 2022] POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:33:33.301961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:33.302710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:33.308737 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:33.309219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:33.309679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:33.310381 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:33.310849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:33.311247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:33.450727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:33.459698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a5bffa8b-9dbb-444a-8df5-3a2e6f8a1b8d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.161705 Sep 13 15:33:33.460392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 260/453] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:33 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:33.526185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:33.527183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:33.537061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:33.537857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:33.538880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:33.540032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:33.540780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:33.541483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:33.688536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:33.697014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:33.698420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:33.699587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-de55e8e2-dcb6-4f17-a0dd-4de8ca2ca1da tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.179672 Sep 13 15:33:33.700142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 261/454] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:33 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:33:34.487575 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:34.488276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:34.495201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:34.495687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:34.496111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:34.496793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:34.497242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:34.497652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:34.641418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:34.654798 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e691fa9e-8414-4f34-aea5-e942dbd91ee9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.172210 Sep 13 15:33:34.655662 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 262/455] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:34 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:34.729675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:34.730641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:34.740006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:34.740648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:34.741311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:34.742385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:34.743149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:34.743793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:34.883658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:34.894803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:34.896291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:34.897453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a19df604-5057-4555-af98-075e5d7c0b91 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.173691 Sep 13 15:33:34.897989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 263/456] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:34 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:35.679382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:35.679945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:35.686947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:35.687435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:35.687893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:35.688666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:35.689123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:35.689547 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:35.833911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:35.847532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f8239c42-85c6-43cb-9152-b3e137de1860 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.171820 Sep 13 15:33:35.848299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 264/457] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:35 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:35.923985 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:35.924582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:35.931087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:35.931568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:35.931993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:35.932684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:35.933131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:35.933548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:36.062313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:36.070729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:36.072160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:36.073306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4158dc53-8109-4919-a94d-8aa771b6da81 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.153463 Sep 13 15:33:36.073860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 265/458] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:35 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:36.879421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:36.880196 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:36.888431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:36.889033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:36.889571 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:36.890479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:36.891048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:36.891573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:37.035683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:37.044156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5960cafa-86ae-48fe-a932-b7e53b5b1e04 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.170902 Sep 13 15:33:37.044729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 266/459] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:36 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:37.099181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:37.099782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:37.105968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:37.106485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:37.106921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:37.107608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:37.108062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:37.108484 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:37.252514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:37.261160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:37.262623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:37.263787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-982d1e9f-87fb-429d-9a8a-281175512548 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.168723 Sep 13 15:33:37.264359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 267/460] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:37 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:33:38.073048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:38.073962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:38.083432 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:38.083921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:38.084356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:38.085051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:38.085511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:38.085926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:38.230317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:38.239338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-435320a6-7478-45b5-9f0b-b8be1b5ff6e6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.173082 Sep 13 15:33:38.239936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 268/461] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:38 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:38.292081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:38.292679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:38.299048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:38.299528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:38.299953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:38.300639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:38.301083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:38.301500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:38.437003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:38.445997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:38.447463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:38.448621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b5718717-ce49-4e8e-a4c2-64ff4dff8941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.160510 Sep 13 15:33:38.449183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 269/462] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:38 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:39.264777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:39.265534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:39.273938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:39.274475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:39.274890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:39.275572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:39.276044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:39.276472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:39.436965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:39.447958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-11777d15-173c-4de7-8ed7-7897a22f6a0c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.188258 Sep 13 15:33:39.448565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 270/463] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:39 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:39.474791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:39.475671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:39.482184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:39.482672 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:39.483104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:39.483801 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:39.484252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:39.484675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:39.648169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:39.657110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:39.658797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:39.659989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2d6c011d-b5e1-4fc3-b8d3-d0eb8a9432e3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.189420 Sep 13 15:33:39.660595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 271/464] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:39 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:33:40.480245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:40.480949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:40.487687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:40.488148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:40.488600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:40.489292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:40.489751 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:40.490227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:40.622636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:40.631095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-85c869fa-1036-4691-824e-4692b555c9cb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.154828 Sep 13 15:33:40.631702 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 272/465] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:40 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:40.686070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:40.686514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:40.693577 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:40.694083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:40.694521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:40.695206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:40.695651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:40.696070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:40.831642 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:40.839994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:40.841781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:40.842974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ef2ab060-4c26-4b36-919e-3d8443230a03 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.161109 Sep 13 15:33:40.843505 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 273/466] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:40 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:41.655927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:41.656500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:41.663936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:41.664429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:41.664864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:41.665573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:41.666034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:41.666532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:41.670645 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:41.800334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:41.809000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-de7602cd-f8d0-4c3e-925e-08bb873b0d88 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.157015 Sep 13 15:33:41.809552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 274/467] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:41 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:41.871833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:41.872822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:41.884016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:41.884813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:41.885528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:41.886721 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:41.887521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:41.888228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:42.045078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:42.057695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:42.060289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:42.062283 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a6bddee0-46a1-4b08-b652-a09b63f1cb32 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.196333 Sep 13 15:33:42.063074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 275/468] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:41 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:42.836636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:42.837611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:42.848091 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:42.848578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:42.849016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:42.849709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:42.850185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:42.850612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:42.984403 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:42.997314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d82a8c80-cba3-48cd-9710-5dd90a4280b7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.167172 Sep 13 15:33:42.997895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 276/469] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:42 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:43.093299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:43.094581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:43.105484 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:43.106356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:43.107094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:43.108202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:43.108947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:43.109696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:43.249975 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:43.259901 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:43.261350 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:43.262555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-60c6a844-d4fd-4c7d-a3b1-5bdd20799b75 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1745 microversion: 2.20 time: 0.176897 Sep 13 15:33:43.263124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 277/470] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:43 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:44.021537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:44.022266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:44.029117 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:44.029602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:44.030040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:44.030795 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:44.031254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:44.031687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:44.170363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:44.179629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3d2b921f-79af-4054-9418-aea8e455ba66 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.162452 Sep 13 15:33:44.180208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 278/471] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:44 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:44.292671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:44.293560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:44.303882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:44.304695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:44.305416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:44.306635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:44.307395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:44.308098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:44.448249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:44.456427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:44.457851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:44.459021 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cf349c75-db60-458a-ba9b-12581bcff477 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1745 microversion: 2.20 time: 0.173124 Sep 13 15:33:44.459573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 279/472] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:44 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:45.203496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:45.204122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:45.211008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:45.211493 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:45.211941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:45.212608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:45.213073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:45.213474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:45.348507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:45.357081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d5a87d65-7c29-49c9-bf31-f623908eedd0 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.157440 Sep 13 15:33:45.357875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 280/473] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:45 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:45.362393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-3b1b9e32-a6fe-45af-aa74-c6bf9d252266 req-50e6ce1e-ec79-409c-b635-021267ee2991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b86fc1-70f9-4cbe-a998-ec6aef1ba750", "name": "network-vif-plugged", "status": "completed", "tag": "7f6adc72-52bc-432c-b1c8-d041a0a6fe1b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:45.371855 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3b1b9e32-a6fe-45af-aa74-c6bf9d252266 req-50e6ce1e-ec79-409c-b635-021267ee2991 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:45.372334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3b1b9e32-a6fe-45af-aa74-c6bf9d252266 req-50e6ce1e-ec79-409c-b635-021267ee2991 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:45.372793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3b1b9e32-a6fe-45af-aa74-c6bf9d252266 req-50e6ce1e-ec79-409c-b635-021267ee2991 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:45.383754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-3b1b9e32-a6fe-45af-aa74-c6bf9d252266 req-50e6ce1e-ec79-409c-b635-021267ee2991 service nova] Creating event network-vif-plugged:7f6adc72-52bc-432c-b1c8-d041a0a6fe1b for instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 on hv-cinder-85743 Sep 13 15:33:45.388735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-3b1b9e32-a6fe-45af-aa74-c6bf9d252266 req-50e6ce1e-ec79-409c-b635-021267ee2991 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029717 Sep 13 15:33:45.389327 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 281/474] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:33:45.488461 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:45.489069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:45.495688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:45.496174 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:45.496602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:45.497296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:45.497745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:45.498170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:45.640126 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:45.648973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:45.651720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:45.653510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cec09eba-0add-4abf-8df9-05b2ed167132 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1745 microversion: 2.20 time: 0.170249 Sep 13 15:33:45.654130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 282/475] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:45 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:46.381978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:46.382701 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:46.389871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:46.390396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:46.390845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:46.391696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:46.392206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:46.392633 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:46.537934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:46.549911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-411dc177-b407-4f38-8885-b0e8195f7db9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.172309 Sep 13 15:33:46.550892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 283/476] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:46 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:46.682686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:46.683295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:46.691646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:46.692148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:46.692568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:46.693223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:46.693707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:46.694159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:46.829824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:46.838685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:46.840469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:46.841617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2b366cf6-0c2a-444d-a81c-b6c6b1d4cd9e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1745 microversion: 2.20 time: 0.165128 Sep 13 15:33:46.842199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 284/477] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:46 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:47.578291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:47.579266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:47.586787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:47.587271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:47.587700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:47.588478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:47.588931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:47.589351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:47.723917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:47.732494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7b77923e-0c26-474b-8c3e-d1e21cb42c77 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1722 microversion: 2.1 time: 0.161031 Sep 13 15:33:47.733104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 285/478] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:47 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:47.871186 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:47.872048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:47.882670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:47.883525 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:47.884237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:47.885360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:47.886127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:47.886826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:48.023560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:48.032054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:48.033625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:48.034807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b16be7c7-fce6-49cf-8a54-75e30ba4532f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1745 microversion: 2.20 time: 0.170390 Sep 13 15:33:48.035368 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 286/479] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:47 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:48.757242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:48.757903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:48.764512 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:48.764997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:48.765428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:48.766130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:48.766602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:48.767023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:48.925955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:48.934619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c240e25e-cd1b-40bb-bce2-9b234430f44d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1699 microversion: 2.1 time: 0.181332 Sep 13 15:33:48.935163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 287/480] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:48 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1699 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:48.956544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfbb01f6-73b5-4876-b348-607606dbcbf9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:33:48.962762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfbb01f6-73b5-4876-b348-607606dbcbf9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:48.963244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfbb01f6-73b5-4876-b348-607606dbcbf9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:48.963669 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfbb01f6-73b5-4876-b348-607606dbcbf9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:48.986089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bfbb01f6-73b5-4876-b348-607606dbcbf9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Going to try to start instance {{(pid=120658) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 15:33:49.034856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bfbb01f6-73b5-4876-b348-607606dbcbf9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.081770 Sep 13 15:33:49.035487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 288/481] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:33:48 2022] POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:33:49.043821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:49.044510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:49.050731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:49.051212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:49.051642 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:49.052328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:49.052796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:49.053212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:49.191288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:49.199792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6280bf48-9445-401e-b552-81e1c42178da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1708 microversion: 2.1 time: 0.159900 Sep 13 15:33:49.200341 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 289/482] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:49 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:49.204848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:49.206030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:49.211662 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:49.212158 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:49.212592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:49.213299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:49.213773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:49.214227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:49.233364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:49.352694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:49.361102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:49.362671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:49.363830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cc85f192-8d7b-43d3-92e7-2dfbbb142889 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1745 microversion: 2.20 time: 0.162551 Sep 13 15:33:49.364421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 290/483] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:49 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:50.225935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:50.226624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:50.233527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:50.234016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:50.234492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:50.235186 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:50.235641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:50.236064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:50.368313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:50.378175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2c32c8f9-4213-442f-bbbc-7ca0b5c5a033 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1708 microversion: 2.1 time: 0.156579 Sep 13 15:33:50.391133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 291/484] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:50 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1708 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:33:50.397483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:50.398363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:50.404490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:50.404963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:50.405387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:50.406123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:50.406572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:50.407015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:50.543086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:50.551670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:50.553130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:50.554306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8f019453-837d-4728-a45a-5163f7100617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.162087 Sep 13 15:33:50.554870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 292/485] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:50 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:51.405790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:51.406859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:51.414675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:51.415157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:51.415581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:51.416578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:51.417034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:51.417453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:51.562218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:51.573002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-192964a8-2474-4207-bf38-c2b44b5dac41 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1712 microversion: 2.1 time: 0.171521 Sep 13 15:33:51.588494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 293/486] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:33:51 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1712 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:33:51.596402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:51.597402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:51.604172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:51.605000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:51.605610 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:51.606634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:51.607263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:51.607865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:51.768138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:51.776924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:51.778406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:51.780035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-324cefcf-ec26-4cab-973e-f15e4ad80db0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.190243 Sep 13 15:33:51.780724 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 294/487] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:51 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:52.812586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:52.813417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:52.816523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:33:52.824595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:52.825975 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:52.826931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:52.828085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:52.829282 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:52.829952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:52.974813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:52.985179 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:52.986978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:52.988143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-73c58e23-b6e8-4627-a52f-8f3c2cdc70ca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.182055 Sep 13 15:33:52.988695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 295/488] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:52 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:54.014559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:54.015245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:54.022529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:54.023128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:54.023619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:54.024386 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:54.024955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:54.025419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:54.173149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:54.182623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:54.184050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:54.185606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-089c2d06-e1de-41ac-9d98-1e7acfd78330 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.175222 Sep 13 15:33:54.186594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 296/489] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:54 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:55.218004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:55.219567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:55.227091 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:55.227569 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:55.228046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:55.228756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:55.229191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:55.229990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:55.391683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:55.401143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:55.402815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:55.403939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6a8cdfc7-cdf2-46cb-bbd5-87e8aa5a2f18 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.192934 Sep 13 15:33:55.405223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 297/490] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:55 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:56.430689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:56.432249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:56.439821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:56.440318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:56.440757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:56.441503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:56.441963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:56.442428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:56.591974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:56.601289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:56.602876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:56.604051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-727241a3-d425-4b5d-bb27-35eda6ae0617 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.177518 Sep 13 15:33:56.605148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 298/491] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:56 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:57.630642 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:57.631304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:57.637736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:57.638292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:57.638789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:57.639703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:57.640298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:57.640931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:57.794785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:57.804311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:57.806050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:57.807516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a7a09c16-7909-4c60-b6f7-536169c66f77 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.181432 Sep 13 15:33:57.808263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 299/492] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:57 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:33:57.906218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e0091362-48a2-4a42-b70c-55458f8c8375 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Calling method '.version_select at 0x7f4bbf3ad9d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:57.948633 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e0091362-48a2-4a42-b70c-55458f8c8375 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-806206350" status: 202 len: 0 microversion: 2.1 time: 0.046680 Sep 13 15:33:57.949509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 300/493] 10.222.0.16 () {58 vars in 1260 bytes} [Tue Sep 13 15:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-806206350 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:33:58.835739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:33:58.836673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:33:58.853950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:58.855068 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:58.855793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:58.856677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:33:58.857389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:33:58.857914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:33:59.022637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:59.032579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:59.034681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:33:59.037358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2499669e-91c5-4a46-92b8-b4a80185c0e1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.208300 Sep 13 15:33:59.051066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 301/494] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:33:58 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:34:00.066339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:00.066992 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:00.077492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:00.082602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:00.083569 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:00.085282 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:00.086632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:00.087076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:00.364309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:00.384620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:00.387077 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:00.389450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-52eedeb8-a636-4c8b-9e93-f9878e4d498a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.328399 Sep 13 15:34:00.403033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 302/495] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:00 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:34:01.425193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:01.437665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:01.451405 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:01.458578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:01.459258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:01.462194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:01.462828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:01.463434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:01.733456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:01.744749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:01.747230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:01.749746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-27ebfda6-5961-4a44-8a42-6be026de718c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1740 microversion: 2.20 time: 0.336719 Sep 13 15:34:01.763884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 303/496] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:01 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:34:02.778556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:02.779213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:02.785885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:02.786424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:02.786862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:02.787559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:02.788105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:02.788666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:02.932773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:02.942177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:02.943638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:02.944806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-68e2985d-8baf-4270-a1c4-92acea82cc57 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1722 microversion: 2.20 time: 0.170326 Sep 13 15:34:02.945339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 304/497] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:02 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:03.971794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:03.972459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:03.979228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:03.979746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:03.980180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:03.980886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:03.981336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:03.981761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:04.120467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:04.135171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:04.136628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:04.139051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7e3fe824-ca55-4f4a-b11a-0d3529d1da39 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1722 microversion: 2.20 time: 0.170550 Sep 13 15:34:04.150368 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 305/498] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:03 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:05.170515 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:05.171206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:05.179552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:05.180041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:05.180470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:05.181163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:05.181635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:05.182251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:05.383125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:05.391729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:05.393503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:05.394733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-12fc169e-1f8d-4d30-ac54-c131057057c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1722 microversion: 2.20 time: 0.230514 Sep 13 15:34:05.395308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 306/499] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:05 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:34:06.420053 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:06.420656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:06.428134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:06.428620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:06.429044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:06.429782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:06.430347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:06.430770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:06.570278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:06.578873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:06.580561 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:06.581704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-14ec29f7-f152-4093-8be3-072f172f3ab1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1665 microversion: 2.20 time: 0.165593 Sep 13 15:34:06.582534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 307/500] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:06 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:34:06.607166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9960a421-8040-42fb-860c-9da567751a8e"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:06.609923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:06.616352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:06.616834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:06.617256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:06.617926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:06.618418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:06.618831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:06.622615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:06.934066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-913def5a-33e5-403b-b2a8-1b0ad72d8368 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330805 Sep 13 15:34:06.934889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 308/501] 10.222.0.16 () {62 vars in 1364 bytes} [Tue Sep 13 15:34:06 2022] POST /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:34:07.090646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:07.091291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:07.099146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:07.100427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:07.100887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:07.101689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:07.102185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:07.102617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:07.150132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120658) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 15:34:07.231853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f57dbce7-c138-4a2d-99bb-a7319fbce7b9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/action" status: 202 len: 0 microversion: 2.20 time: 0.145885 Sep 13 15:34:07.236581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 309/502] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 13 15:34:07 2022] POST /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 15:34:07.242643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:07.243273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:07.249620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:07.249898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:07.250408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:07.251334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:07.251952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:07.252366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:07.406575 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:07.416243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:07.418083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:07.419870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-afd0dda1-d98e-475e-bb9c-e8784dc00f67 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1751 microversion: 2.20 time: 0.182148 Sep 13 15:34:07.420814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 310/503] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:07 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:07.459364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-1d1e9152-5bfb-4a4a-963d-a5d7fd0b2f06 req-6745e2e3-5429-4fcb-bf4b-4eb397edb37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b86fc1-70f9-4cbe-a998-ec6aef1ba750", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6adc72-52bc-432c-b1c8-d041a0a6fe1b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:07.470862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1d1e9152-5bfb-4a4a-963d-a5d7fd0b2f06 req-6745e2e3-5429-4fcb-bf4b-4eb397edb37e service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:07.471378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1d1e9152-5bfb-4a4a-963d-a5d7fd0b2f06 req-6745e2e3-5429-4fcb-bf4b-4eb397edb37e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:07.471779 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1d1e9152-5bfb-4a4a-963d-a5d7fd0b2f06 req-6745e2e3-5429-4fcb-bf4b-4eb397edb37e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:07.492695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.compute.server_external_events [req-1d1e9152-5bfb-4a4a-963d-a5d7fd0b2f06 req-6745e2e3-5429-4fcb-bf4b-4eb397edb37e service nova] Unable to find a host for instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750. Dropping event network-vif-unplugged {{(pid=120658) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 15:34:07.493871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-1d1e9152-5bfb-4a4a-963d-a5d7fd0b2f06 req-6745e2e3-5429-4fcb-bf4b-4eb397edb37e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038823 Sep 13 15:34:07.495124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 311/504] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 15:34:08.449355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:08.450376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:08.462731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:08.464446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:08.465344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:08.467005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:08.467955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:08.468659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:08.614421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:08.623431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:08.624504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:08.625652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-62e037cc-82c6-4bb4-bc1a-39e68a4d8293 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1751 microversion: 2.20 time: 0.183211 Sep 13 15:34:08.627103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 312/505] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:08 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:09.652102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:09.652666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:09.659607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:09.660163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:09.660587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:09.661276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:09.661720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:09.662134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:09.798339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:09.807394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:09.808817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:09.809977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fd3e9545-2d48-476a-8329-ef3bb887e15b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.161918 Sep 13 15:34:09.810564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 313/506] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:09 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:10.837049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:10.837731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:10.844807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:10.845323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:10.845748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:10.846480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:10.846880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:10.847313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:11.006355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:11.017041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:11.018943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:11.020463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6554cbaf-64b0-4fb5-8ad9-31b250b892fd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.187834 Sep 13 15:34:11.032049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 314/507] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:10 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:12.049828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:12.050522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:12.058824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:12.059385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:12.059884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:12.060725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:12.061215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:12.061705 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:12.203298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:12.219856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:12.221431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:12.222869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bd153399-bbaf-46ef-a959-3e35530f188e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.177806 Sep 13 15:34:12.223457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 315/508] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:12 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:13.248660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:13.249365 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:13.256785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:13.257355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:13.257837 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:13.258622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:13.259290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:13.259753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:13.398171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:13.406933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:13.408357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:13.409634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a11d57e5-3152-4b03-a3c1-3f1fe3b1d94f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.164982 Sep 13 15:34:13.410222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 316/509] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:13 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:13.606753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:13.607155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:13.613567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:13.614041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:13.614503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:13.615189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:13.615636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:13.616050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:13.658965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bfe4b777-fe67-429e-9775-77f151fa9ef8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/ips" status: 200 len: 149 microversion: 2.1 time: 0.056178 Sep 13 15:34:13.660167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 317/510] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:34:13 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:34:14.436871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:14.438483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:14.445698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:14.446262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:14.446688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:14.447381 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:14.447833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:14.448248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:14.585289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:14.594446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:14.595891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:14.597192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1964f0cf-b803-4f2f-8231-6d341440c18f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.165147 Sep 13 15:34:14.597778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 318/511] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:14 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:15.635880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:15.638550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:15.648368 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:15.649214 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:15.649885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:15.650814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:15.651413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:15.651979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:15.789530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:15.798479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:15.799922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:15.801089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8fbbb0db-f424-4093-8fa7-455868ca790c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.170905 Sep 13 15:34:15.801780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 319/512] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:15 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:34:16.128000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd7658f5-c096-4bbb-9181-c8cabbae5a61"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:16.130537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:16.137412 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:16.137970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:16.138433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:16.139221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:16.139754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:16.140169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:26.137031 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:26.195408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:26.208660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c6401412-c3d6-46f2-8abb-bfaa83828e2c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.084512 Sep 13 15:34:26.209262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 320/513] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:34:16 2022] POST /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments => generated 194 bytes in 10086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:34:26.215528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:26.216213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:26.223463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:26.224241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:26.224676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:26.225363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:26.225808 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:26.226270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:26.366454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:26.376144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:26.377574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:26.378773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-436d6007-2022-4737-bd7d-3df0ef4e3448 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.168283 Sep 13 15:34:26.379331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 321/514] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:26 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:27.407809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:27.408542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:27.417922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:27.418434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:27.418861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:27.419547 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:27.419997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:27.420411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:27.559942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:27.568911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:27.570378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:27.571576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d818cc7a-b9ab-4797-8e21-baab12c6c8d6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.170106 Sep 13 15:34:27.572134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 322/515] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:27 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:28.606366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:28.607024 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:28.613678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:28.614161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:28.614622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:28.615307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:28.615753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:28.616169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:28.747446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:28.756408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:28.757866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:28.759038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5cf01b0d-4d98-4fd4-8abf-86cc48b80528 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.157801 Sep 13 15:34:28.759590 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 323/516] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:28 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:29.785912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:29.786729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:29.794614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:29.795189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:29.795697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:29.805242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:29.805866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:29.806416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:29.949387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:29.958735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:29.960178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:29.961339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2e2bef3f-1ef1-414f-acaf-d7fda82a984b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.180112 Sep 13 15:34:29.961905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 324/517] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:29 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:30.987163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:30.987835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:30.994938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:30.995427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:30.995857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:30.996553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:30.997009 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:30.997433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:31.128624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:31.137883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:31.139392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:31.140556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-684c8f65-7730-4923-b5e5-42a91e5f241f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.157408 Sep 13 15:34:31.141116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 325/518] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:30 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:32.170193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:32.171615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:32.182635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:32.183094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:32.183522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:32.184233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:32.184677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:32.185094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:32.332934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:32.342380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:32.343815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:32.344967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-666f888e-45ab-4cec-adbc-24b1e2ec5929 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.181443 Sep 13 15:34:32.345563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 326/519] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:32 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:33.374952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:33.375913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:33.386636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:33.387122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:33.387552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:33.388250 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:33.388704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:33.389123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:33.520496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:33.529815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:33.531297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:33.532454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-85a8bd68-fb54-4077-aebd-bdd44bc6b4eb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.164817 Sep 13 15:34:33.533014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 327/520] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:33 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:34.563573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:34.564678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:34.574722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:34.575527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:34.576257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:34.577400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:34.578190 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:34.579048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:34.735102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:34.746898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:34.748401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:34.749582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-26eb1223-ee1d-4387-ae68-e16573d0b188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.193508 Sep 13 15:34:34.750148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 328/521] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:34 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:35.777027 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:35.777672 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:35.785102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:35.785589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:35.786022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:35.786859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:35.787232 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:35.787653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:35.928962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:35.937906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:35.939430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:35.940585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-71d44c31-454a-438c-bf9e-9bb992a3ae0a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.168256 Sep 13 15:34:35.941120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 329/522] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:35 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:34:35.951075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5e18ec38-791a-4f23-b044-92c495ab4d41 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: .version_select at 0x7f4bbf44cd30>, body: {"keypair": {"name": "tempest-keypair-1240054041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9vPNz2gBqXN+KWQ8bld8OhXPU+R5xDWOJbnPsCztfmDER3mf/QtK+fqeqKifZcQru5LsS4YFM8hyuj7pV9ouiYiV9QEs5SV2zgHXW+Fl3M04MIwYDY2ETo7ntDdg9DtA=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:35.967566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-5e18ec38-791a-4f23-b044-92c495ab4d41 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:34:35.971552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-5e18ec38-791a-4f23-b044-92c495ab4d41 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:34:36.001714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5e18ec38-791a-4f23-b044-92c495ab4d41 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053870 Sep 13 15:34:36.003010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 330/523] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:34:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:34:36.966897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:36.967597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:36.973985 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:36.974503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:36.974931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:36.975658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:36.976106 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:36.976552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:37.191618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:37.202567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:37.204008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:37.205171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d85b5cef-1a29-42ab-bef2-31ededde156b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.243384 Sep 13 15:34:37.205728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 331/524] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:36 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:37.413379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-793179710", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dae42ed5-9203-4331-a516-9ad32fc49ad2"}], "security_groups": [{"name": "tempest-securitygroup--23842565"}], "key_name": "tempest-keypair-1240054041", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:37.524205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] validate_networks() for [('dae42ed5-9203-4331-a516-9ad32fc49ad2', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:34:37.924074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:34:37.924495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:34:37.924964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:34:37.925367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:34:37.925747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:34:37.935491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:37.935975 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:37.936419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:37.937141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:37.937594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:37.938013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:37.954983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:34:37.959137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:34:37.971558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:34:37.973817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:34:38.021849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7a6990ea-6ef5-4139-be62-c8b838e12425 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.612742 Sep 13 15:34:38.028617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 332/525] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:34:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:34:38.028617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-521f7a0b-9290-4955-ab02-799937683bfe req-664f4940-85bd-4ce0-8811-12aae619e1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b86fc1-70f9-4cbe-a998-ec6aef1ba750", "name": "network-vif-plugged", "status": "completed", "tag": "7f6adc72-52bc-432c-b1c8-d041a0a6fe1b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:38.037933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-521f7a0b-9290-4955-ab02-799937683bfe req-664f4940-85bd-4ce0-8811-12aae619e1fd service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:38.038464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-521f7a0b-9290-4955-ab02-799937683bfe req-664f4940-85bd-4ce0-8811-12aae619e1fd service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:38.038891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-521f7a0b-9290-4955-ab02-799937683bfe req-664f4940-85bd-4ce0-8811-12aae619e1fd service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:38.050490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-521f7a0b-9290-4955-ab02-799937683bfe req-664f4940-85bd-4ce0-8811-12aae619e1fd service nova] Creating event network-vif-plugged:7f6adc72-52bc-432c-b1c8-d041a0a6fe1b for instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 on hv-cinder-85743 Sep 13 15:34:38.055617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-521f7a0b-9290-4955-ab02-799937683bfe req-664f4940-85bd-4ce0-8811-12aae619e1fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031728 Sep 13 15:34:38.056232 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 333/526] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:34:38.061483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1e16b613-fd97-4086-9ff7-69d9a2ac1cde tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:38.062197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1e16b613-fd97-4086-9ff7-69d9a2ac1cde tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:38.117899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1e16b613-fd97-4086-9ff7-69d9a2ac1cde tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:38.125039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1e16b613-fd97-4086-9ff7-69d9a2ac1cde tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1241 microversion: 2.1 time: 0.067393 Sep 13 15:34:38.125586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 334/527] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:38 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:38.231123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:38.231625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:38.238613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:38.239136 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:38.239648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:38.240349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:38.240806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:38.241284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:38.381968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:38.391904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:38.393401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:38.394598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-52ba9336-fd1c-4140-931f-806b5b0a7c51 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.167642 Sep 13 15:34:38.395145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 335/528] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:38 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:39.147745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:39.148366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:39.155579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:39.156080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:39.156510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:39.157202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:39.157638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:39.158054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:39.220722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:39.228805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ebe6eaf8-6257-45a3-9170-272e709f68f2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1293 microversion: 2.1 time: 0.084847 Sep 13 15:34:39.229376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 336/529] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:39 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:34:39.421758 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:39.422404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:39.428927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:39.429420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:39.429861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:39.430602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:39.431061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:39.431647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:39.571905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:39.581167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:39.582635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:39.583797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e201a52e-b8c4-48fd-b922-b86a90f42c5e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.166072 Sep 13 15:34:39.584361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 337/530] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:39 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:40.254947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:40.255891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:40.264773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:40.265254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:40.265685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:40.266406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:40.266858 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:40.267272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:40.352868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:40.361572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7543c5fd-47cc-4187-b608-1590859ea4b4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1293 microversion: 2.1 time: 0.111753 Sep 13 15:34:40.362251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 338/531] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:40 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:40.609253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:40.609955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:40.616723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:40.617289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:40.617730 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:40.618509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:40.619218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:40.619710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:40.756426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:40.765541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:40.767393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:40.768580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7866e415-a3d8-4df1-8fa0-2ade82dd2bac tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1809 microversion: 2.20 time: 0.163556 Sep 13 15:34:40.769144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 339/532] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:40 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:41.385255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:41.385932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:41.392722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:41.393202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:41.393628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:41.394358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:41.394804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:41.395219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:41.459435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:41.463810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:41.469540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4b2e1048-c6cc-4e3d-b2ed-9a3d44fa5a75 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1299 microversion: 2.1 time: 0.088275 Sep 13 15:34:41.470147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 340/533] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:41 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:41.811784 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:41.812486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:41.818866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:41.819698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:41.820197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:41.820954 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:41.821465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:41.822016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:41.974182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:41.988782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:41.990240 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:41.991755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5e5742cf-2662-4aa6-b794-345256e26031 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1796 microversion: 2.20 time: 0.184686 Sep 13 15:34:41.992323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 341/534] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:34:41 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1796 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:34:42.494718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:42.495353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:42.501921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:42.502440 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:42.502876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:42.503593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:42.504024 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:42.504651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:42.648979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:42.657520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d600e0ca-4d83-49e0-a543-898163738841 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.166762 Sep 13 15:34:42.658095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 342/535] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:42 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:42.662693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-fef9b7a6-4b98-4495-af76-0f1af9796ad0 req-a634585d-1b10-404a-b113-5c22b8f3d437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef3959b-a730-4f58-95ac-f15f415f8217", "tag": "454b128f-b9b2-4847-bdbf-f828f42cd0da"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:42.672587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fef9b7a6-4b98-4495-af76-0f1af9796ad0 req-a634585d-1b10-404a-b113-5c22b8f3d437 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:42.673073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fef9b7a6-4b98-4495-af76-0f1af9796ad0 req-a634585d-1b10-404a-b113-5c22b8f3d437 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:42.673687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fef9b7a6-4b98-4495-af76-0f1af9796ad0 req-a634585d-1b10-404a-b113-5c22b8f3d437 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:42.684347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-fef9b7a6-4b98-4495-af76-0f1af9796ad0 req-a634585d-1b10-404a-b113-5c22b8f3d437 service nova] Creating event network-changed:454b128f-b9b2-4847-bdbf-f828f42cd0da for instance fef3959b-a730-4f58-95ac-f15f415f8217 on hv-cinder-85743 Sep 13 15:34:42.689224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-fef9b7a6-4b98-4495-af76-0f1af9796ad0 req-a634585d-1b10-404a-b113-5c22b8f3d437 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029854 Sep 13 15:34:42.689882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 343/536] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:34:43.684871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:43.685782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:43.693359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:43.693933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:43.694479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:43.695285 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:43.695812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:43.696319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:43.841123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:43.849130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2ad35e60-98c9-465b-a747-5a1e4ea1f565 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.171279 Sep 13 15:34:43.849697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 344/537] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:43 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:44.876290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:44.877407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:44.887122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:44.887605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:44.888029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:44.888734 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:44.889164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:44.889580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:45.023954 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:45.036825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8d64ff8d-c156-4f06-8920-9555cd808875 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.167294 Sep 13 15:34:45.037750 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 345/538] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:44 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:46.061618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:46.062354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:46.069133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:46.069622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:46.070060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:46.070793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:46.071249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:46.071674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:46.214961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:46.223535 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0ef53c82-8ea3-4f11-8527-a55ced28470c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.165962 Sep 13 15:34:46.224072 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 346/539] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:46 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:47.250792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:47.251874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:47.262183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:47.262704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:47.263138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:47.263841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:47.264294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:47.264728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:47.406951 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:47.415183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d1037701-a766-4391-a3f7-83c04bfab28b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.171031 Sep 13 15:34:47.415754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 347/540] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:47 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:48.447121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:48.447963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:48.449891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:48.450666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=12 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:48.456950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:48.457448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:48.457897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:48.458625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:48.459071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:48.459528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:48.590462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:48.599234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8f0868f0-47d9-42d4-9176-b5ece3800724 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.157378 Sep 13 15:34:48.599841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 348/541] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:48 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:49.622095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:49.622723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:49.632973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:49.633462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:49.634028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:49.634966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:49.635699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:49.636123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:49.771115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:49.779276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c187d9c6-27ba-48fd-93a3-085ce12896af tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.161218 Sep 13 15:34:49.779869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 349/542] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:49 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:34:49.784330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-c7844e01-f0c8-46fd-a717-878025324a72 req-9f637eb2-4bb6-4218-a4d4-c5b422f16680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef3959b-a730-4f58-95ac-f15f415f8217", "name": "network-vif-plugged", "status": "completed", "tag": "454b128f-b9b2-4847-bdbf-f828f42cd0da"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:49.795040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7844e01-f0c8-46fd-a717-878025324a72 req-9f637eb2-4bb6-4218-a4d4-c5b422f16680 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:49.795548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7844e01-f0c8-46fd-a717-878025324a72 req-9f637eb2-4bb6-4218-a4d4-c5b422f16680 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:49.795958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c7844e01-f0c8-46fd-a717-878025324a72 req-9f637eb2-4bb6-4218-a4d4-c5b422f16680 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:49.807567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-c7844e01-f0c8-46fd-a717-878025324a72 req-9f637eb2-4bb6-4218-a4d4-c5b422f16680 service nova] Creating event network-vif-plugged:454b128f-b9b2-4847-bdbf-f828f42cd0da for instance fef3959b-a730-4f58-95ac-f15f415f8217 on hv-cinder-85743 Sep 13 15:34:49.812741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-c7844e01-f0c8-46fd-a717-878025324a72 req-9f637eb2-4bb6-4218-a4d4-c5b422f16680 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031718 Sep 13 15:34:49.813307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 350/543] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:34:50.806046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:50.807311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:50.815568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:50.816178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:50.816736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:50.817602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:50.818168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:50.818747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:50.955725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:50.964039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-75e82dbb-9213-4053-ab1a-069071f1534b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1365 microversion: 2.1 time: 0.163925 Sep 13 15:34:50.964658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 351/544] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:50 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:51.991373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:51.992492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:52.000214 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:52.000704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:52.001140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:52.001833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:52.002336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:52.002764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:52.135037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:52.145688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-76bb6dc7-30f4-4ecf-943a-8652a89fb9e2 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1556 microversion: 2.1 time: 0.160764 Sep 13 15:34:52.146829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 352/545] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:51 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:52.170036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:52.170544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:52.176301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:52.176775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:52.177201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:52.177911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:52.178385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:52.178802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:52.268357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d51c1dd0-8151-4fbf-bf62-a08c9d2ded8b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101901 Sep 13 15:34:52.269311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 353/546] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:34:52 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:34:53.502362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-c043cdd9-56a2-4a53-a0cc-e59cf21cc034 req-18144849-36e2-48b3-b56c-52d302ba09f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef3959b-a730-4f58-95ac-f15f415f8217", "tag": "454b128f-b9b2-4847-bdbf-f828f42cd0da"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:53.512084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c043cdd9-56a2-4a53-a0cc-e59cf21cc034 req-18144849-36e2-48b3-b56c-52d302ba09f0 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:53.512551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c043cdd9-56a2-4a53-a0cc-e59cf21cc034 req-18144849-36e2-48b3-b56c-52d302ba09f0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:53.512970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c043cdd9-56a2-4a53-a0cc-e59cf21cc034 req-18144849-36e2-48b3-b56c-52d302ba09f0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:53.524253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-c043cdd9-56a2-4a53-a0cc-e59cf21cc034 req-18144849-36e2-48b3-b56c-52d302ba09f0 service nova] Creating event network-changed:454b128f-b9b2-4847-bdbf-f828f42cd0da for instance fef3959b-a730-4f58-95ac-f15f415f8217 on hv-cinder-85743 Sep 13 15:34:53.530456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-c043cdd9-56a2-4a53-a0cc-e59cf21cc034 req-18144849-36e2-48b3-b56c-52d302ba09f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031948 Sep 13 15:34:53.531074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 354/547] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:34:57.162934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:57.166660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:57.169729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:57.179160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:57.179986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:57.180746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:57.181873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:57.182739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:57.183280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:57.262236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fba8a230-6a2e-4ac9-bac4-abb4334e7c6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/action" status: 202 len: 0 microversion: 2.1 time: 0.107201 Sep 13 15:34:57.262868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 355/548] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:34:57 2022] POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:34:57.271878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:57.273218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:57.279700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:57.280242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:57.280703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:57.281501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:57.281976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:57.282517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:57.486478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:57.495184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e7424c1b-a1d3-4425-8fd6-d736d3e1471e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1751 microversion: 2.1 time: 0.227220 Sep 13 15:34:57.502943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 356/549] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:57 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1751 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:34:58.519804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:58.520464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:58.527644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:58.528130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:58.528563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:58.529251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:58.529706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:58.530133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:58.687016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:58.699114 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fd18c328-aaa7-4b3b-8efd-293112af3bd5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.183017 Sep 13 15:34:58.700012 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 357/550] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:58 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:34:58.707328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f27dfa1d-8c9d-4efa-886d-8ace98e875fc"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:34:58.711095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:58.718507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:58.718993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:58.719419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:58.720111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:58.720557 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:58.720974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:58.795016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:34:59.013898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a1d40ae-4205-47f5-b960-89e1e665e7b2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312428 Sep 13 15:34:59.014539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 358/551] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:34:58 2022] POST /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:34:59.734817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:34:59.735480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:34:59.741854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:59.742380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:59.742802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:59.743526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:34:59.743979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:34:59.744392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:34:59.892777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:34:59.906681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5d96f32a-51b5-4279-9710-bb61367b0a22 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.179432 Sep 13 15:34:59.907481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 359/552] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:34:59 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:00.930895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:00.931579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:00.938640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:00.939119 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:00.939547 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:00.940234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:00.940686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:00.941099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:01.089809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:01.100615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-14ae74a4-0003-4859-b733-91dbbf8ace5a tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.173648 Sep 13 15:35:01.101189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 360/553] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:00 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:02.127127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:02.128195 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:02.138396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:02.138851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:02.139346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:02.140033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:02.140475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:02.140890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:02.299505 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:02.308260 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-449c912d-7761-4089-bdc0-d6292e94bc5b tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.186717 Sep 13 15:35:02.308965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 361/554] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:02 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:03.332947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:03.333574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:03.340292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:03.340963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:03.342519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:03.342519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:03.342964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:03.343382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:03.502994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:03.514414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-495f9959-b56d-4032-9905-dd4b36abe36f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.185276 Sep 13 15:35:03.514989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 362/555] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:03 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:04.541111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:04.541786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:04.551769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:04.552329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:04.552690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:04.553696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:04.554318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:04.554905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:04.873177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:04.881720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6ad8c64e-7474-4ab3-8a6c-69b299809802 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.346787 Sep 13 15:35:04.882326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 363/556] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:04 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:05.912202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:05.914559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:05.923582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:05.924090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:05.924527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:05.925227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:05.926937 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:05.927369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:06.093951 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:06.102810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a7ac2fce-eae1-4fe6-8b39-5cc8800315f8 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.196872 Sep 13 15:35:06.103846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 364/557] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:05 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:35:06.615374 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:35:06.617689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:06.624404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:06.624886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:06.625317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:06.625995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:06.626476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:06.626894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:06.651093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lazy-loading 'flavor' on Instance uuid 0782cb8b-a07b-4d5c-8014-23397c7d38c1 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:35:06.796835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-37a2fa11-b6e2-4669-aa5a-3cf85dbaefd3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/action" status: 200 len: 32 microversion: 2.1 time: 0.184957 Sep 13 15:35:06.797420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 365/558] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:35:06 2022] POST /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:35:06.809766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:06.810888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:06.817315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:06.817799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:06.818267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:06.818954 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:06.819404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:06.819825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:06.968875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:06.978748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cde3c165-1b5d-4a27-85a7-38d27a07ca76 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.173181 Sep 13 15:35:06.979540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 366/559] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:06 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:07.127300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:07.128019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:07.135481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:07.135968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:07.136395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:07.137091 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:07.137524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:07.138331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:07.291420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:07.300469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8425d8f7-5685-41c7-8d55-b73dfc29e044 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.177351 Sep 13 15:35:07.301718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 367/560] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:07 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:08.008103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:08.009135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:08.017932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:08.018560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:08.019002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:08.019708 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:08.020163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:08.020615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:08.169988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:08.183484 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f5f43b3f-27e6-4497-ac85-1029f74ddb4e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.181715 Sep 13 15:35:08.184319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 368/561] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:07 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:08.550137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:08.550636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:08.556733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:08.557207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:08.557632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:08.558333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:08.558797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:08.559211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:08.683768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lazy-loading 'services' on Instance uuid 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:35:08.811900 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-891bb6fd-f03b-474d-8f66-23a4280d4b8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-volume_attachments/c509fe7e-8bac-488f-a927-2378a8887c3d" status: 202 len: 0 microversion: 2.1 time: 0.509902 Sep 13 15:35:08.812636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 369/562] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:35:08 2022] DELETE /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-volume_attachments/c509fe7e-8bac-488f-a927-2378a8887c3d => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:35:08.817882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:08.818698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:08.826446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:08.827998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:08.827998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:08.828219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:08.828551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:08.828982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:08.980557 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:08.989711 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b0dd4c87-f5e6-437b-832b-31dd8a5e04fc tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.175942 Sep 13 15:35:08.990301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 370/563] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:08 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:09.217143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:09.217837 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:09.224697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:09.225186 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:09.225616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:09.226356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:09.226811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:09.227236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:09.249145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:09.374037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:09.382852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cdfb9d84-17ba-43a8-9c49-89208a41e873 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.172389 Sep 13 15:35:09.383421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 371/564] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:09 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:09.620215 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:35:09.620843 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:35:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:35:09.954019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f21a70b4-9cd7-40e2-9b27-70d607d8e08c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:35:09.960314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f21a70b4-9cd7-40e2-9b27-70d607d8e08c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:09.960797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f21a70b4-9cd7-40e2-9b27-70d607d8e08c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:09.961601 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f21a70b4-9cd7-40e2-9b27-70d607d8e08c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:09.983485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f21a70b4-9cd7-40e2-9b27-70d607d8e08c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Going to try to stop instance {{(pid=120658) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 15:35:10.028765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f21a70b4-9cd7-40e2-9b27-70d607d8e08c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.078506 Sep 13 15:35:10.029868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 372/565] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:35:09 2022] POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:35:10.034695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:10.035383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:10.041469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:10.041977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:10.042444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:10.043237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:10.043620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:10.044009 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:10.193998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:10.202759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d318420d-388a-4912-87a0-7c7459cbcb86 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.171979 Sep 13 15:35:10.203338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 373/566] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:10 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:10.207750 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:10.208348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:10.214605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:10.215088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:10.215520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:10.216221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:10.216835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:10.217258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:10.357555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:10.365600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c3edc6a5-0fdc-4e33-b4e6-af8aacab3f9a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.161310 Sep 13 15:35:10.366166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 374/567] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:10 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:10.409200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:10.409893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:10.416148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:10.416640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:10.417066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:10.417768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:10.418249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:10.418675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:10.560644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:10.569191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7e7629c7-33b3-4e3e-bf2c-bcc1b062785d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.165743 Sep 13 15:35:10.569771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 375/568] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:10 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:35:11.228137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:11.228845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:11.235938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:11.236425 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:11.236857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:11.237563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:11.238009 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:11.238474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:11.381987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:11.391085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5a771e35-6c57-4a37-a573-4c8c125d56f7 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.167066 Sep 13 15:35:11.391693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 376/569] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:11 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:11.396054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:11.396641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:11.402649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:11.403129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:11.403558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:11.404649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:11.405108 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:11.405553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:11.550899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:11.558708 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b7acfd4d-b893-4df1-a3c0-e302150bf048 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.166077 Sep 13 15:35:11.559254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 377/570] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:11 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:11.594254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:11.594888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:11.601143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:11.601637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:11.602069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:11.602800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:11.603254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:11.603677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:11.736890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:11.745268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5498f2bb-94c5-4999-9cfc-158900cc782d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.155925 Sep 13 15:35:11.745761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 378/571] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:11 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:12.423216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:12.424310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:12.434524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:12.435091 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:12.435523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:12.436455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:12.437083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:12.437643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:12.607212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:12.615875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f277893a-74c6-4ef7-b070-ff6e6697d243 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.199355 Sep 13 15:35:12.616482 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 379/572] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:12 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:12.620822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:12.621414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:12.627566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:12.628049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:12.628477 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:12.629170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:12.629622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:12.630042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:12.768702 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:12.777167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-def9b623-eb35-44ac-9d37-1a11a1c67a94 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.159779 Sep 13 15:35:12.777732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 380/573] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:12 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:12.782463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:12.783058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:12.788645 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:12.789113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:12.789544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:12.790255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:12.790705 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:12.791124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:12.933316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:12.942444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bd755f64-e246-4a18-9c97-cfd5492fe36b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.163672 Sep 13 15:35:12.943012 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 381/574] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:12 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:13.643710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:13.644707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:13.654922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:13.655406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:13.655832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:13.656522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:13.656965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:13.657383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:13.802469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:13.811328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-586378d6-be3d-4189-b308-12e41368e5ef tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1756 microversion: 2.1 time: 0.174235 Sep 13 15:35:13.829434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 382/575] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:13 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:13.829434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:13.829434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:13.829434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:13.829434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:13.830235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:13.830235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:13.830235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:13.830235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:13.959423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:13.967822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f6e2dae5-c3be-448c-aea7-86f0756b72d5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.152460 Sep 13 15:35:13.968367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 383/576] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:13 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:14.082268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:14.082889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:14.089369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:14.089827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:14.090341 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:14.091006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:14.091635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:14.092100 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:14.231103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:14.244043 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-200fe5b9-4816-4d93-8396-8f63c6dc96a3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.274393 Sep 13 15:35:14.244972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 384/577] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:13 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:14.837826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:14.838546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:14.847309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:14.848190 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:14.848978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:14.850281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:14.851112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:14.851872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:15.008469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:15.017131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a6ee0ec9-31dd-4699-ba0f-44feddc5c401 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1759 microversion: 2.1 time: 0.183838 Sep 13 15:35:15.017679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 385/578] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:14 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:15.022233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:15.022847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:15.028384 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:15.028914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:15.029348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:15.030040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:15.030519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:15.030942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:15.163248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:15.172447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7d349dc2-b293-47f3-b443-a693370b7ac1 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.153686 Sep 13 15:35:15.173035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 386/579] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:15 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:15.272036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:15.272858 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:15.281342 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:15.281830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:15.282301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:15.282991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:15.283440 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:15.283857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:15.287934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:15.431272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:15.439919 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b70f4f73-a01b-464f-8c82-bd3882e7f817 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.174598 Sep 13 15:35:15.440494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 387/580] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:15 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:16.199846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:16.200938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:16.208156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:16.208639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:16.209069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:16.209757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:16.210242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:16.210667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:16.341755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:16.350070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a2c7cb6-01ee-4730-a94b-0352d2266552 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.156801 Sep 13 15:35:16.350639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 388/581] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:16 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:35:16.469302 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:16.470019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:16.478362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:16.479371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:16.480059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:16.481174 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:16.482139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:16.483073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:16.630700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:16.641387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-56b3bd17-7ca1-4aa5-a06c-536be7536318 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.177466 Sep 13 15:35:16.641936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 389/582] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:16 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:17.380571 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:17.381315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:17.392147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:17.392992 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:17.393703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:17.394895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:17.395686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:17.396391 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:17.544802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:17.556666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4221655b-5ec2-4e52-ab5b-3cb3a9ba8664 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.183165 Sep 13 15:35:17.557455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 390/583] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:17 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:17.666294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:17.666905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:17.674678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:17.675170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:17.679870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:17.680566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:17.680988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:17.681444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:17.818234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:17.826996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1c4067a2-d587-496c-9d40-13d0c3070d1c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.165821 Sep 13 15:35:17.827570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 391/584] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:17 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:18.581181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:18.581859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:18.589410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:18.590454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:18.590454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:18.592145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:18.592768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:18.593231 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:18.730509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:18.740706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a13856a4-3d30-4317-96ba-5177d13bcc32 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.163473 Sep 13 15:35:18.741472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 392/585] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:18 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:18.850506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:18.851081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:18.857998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:18.858567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:18.859065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:18.859802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:18.860293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:18.860753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:18.997786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:19.006293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-86f8728b-bd95-424c-ac33-5ce34dea1515 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.160150 Sep 13 15:35:19.006849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 393/586] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:18 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:19.764568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:19.765208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:19.773078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:19.773566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:19.774004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:19.774741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:19.775204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:19.775628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:19.920530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:19.929187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6e42312b-d89f-45e1-bb0f-6b911e96f605 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1676 microversion: 2.1 time: 0.168421 Sep 13 15:35:19.929548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 394/587] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:19 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:20.029074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:20.029677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:20.038222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:20.038688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:20.039118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:20.039834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:20.040279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:20.040704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:20.186945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:20.195844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8469f852-226f-4a63-85ff-0f782ea077e6 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.170698 Sep 13 15:35:20.196415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 395/588] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:20 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:20.956980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:20.957928 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:20.968299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:20.969143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:20.969615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:20.970414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:20.970868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:20.971289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:21.111823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:21.119821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-407052b7-50c9-41f2-8471-454cc3697d10 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1653 microversion: 2.1 time: 0.169642 Sep 13 15:35:21.120389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 396/589] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:20 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1653 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:21.142939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f788ce27-669e-4d74-b82f-5795195ec4f7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:35:21.149030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f788ce27-669e-4d74-b82f-5795195ec4f7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:21.149508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f788ce27-669e-4d74-b82f-5795195ec4f7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:21.149937 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f788ce27-669e-4d74-b82f-5795195ec4f7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:21.173854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f788ce27-669e-4d74-b82f-5795195ec4f7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Going to try to start instance {{(pid=120658) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 15:35:21.220211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f788ce27-669e-4d74-b82f-5795195ec4f7 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.080965 Sep 13 15:35:21.220652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 397/590] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:35:21 2022] POST /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:35:21.225756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:21.226508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:21.232974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:21.233476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:21.233908 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:21.234718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:21.235177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:21.235601 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:21.373338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:21.382345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c9b5dbdc-a43c-46cb-8405-fe33eef9ab20 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.160466 Sep 13 15:35:21.382969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 398/591] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:21 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:21.387543 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:21.388172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:21.394722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:21.395214 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:21.395650 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:21.396352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:21.397089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:21.397225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:21.528198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:21.536231 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eab09889-a1d4-4f4c-a7d4-c672b0b2e1ec tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1662 microversion: 2.1 time: 0.152282 Sep 13 15:35:21.536807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 399/592] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:21 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:22.409003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:22.409802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:22.416492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:22.416981 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:22.417417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:22.418117 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:22.418600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:22.419024 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:22.568114 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:22.579986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e961ad5b-2845-44d6-9da9-f6d4a28df4d3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.176332 Sep 13 15:35:22.580722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 400/593] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:22 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:22.585208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:22.586137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:22.592005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:22.592510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:22.592941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:22.593625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:22.594143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:22.594629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:22.726177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:22.738207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9fa12bb1-6173-4fb7-af64-726a499b8ac9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1662 microversion: 2.1 time: 0.156208 Sep 13 15:35:22.738739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 401/594] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:22 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:23.608298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:23.609401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:23.616661 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:23.617145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:23.617571 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:23.618293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:23.618720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:23.619165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:23.762544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:23.766052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:23.772168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3cead2bb-5644-426c-b003-f92ad4b26719 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.170506 Sep 13 15:35:23.772733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 402/595] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:23 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:23.777671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:23.778296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:23.784406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:23.784892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:23.785319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:23.786054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:23.786528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:23.786946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:23.924934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:23.933387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-95777de2-b109-4448-949b-5f1535a399a9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1666 microversion: 2.1 time: 0.159387 Sep 13 15:35:23.934191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 403/596] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:23 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:24.801656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:24.802761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:24.813678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:24.814308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:24.814747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:24.815438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:24.815887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:24.816305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:24.947748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:24.957058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-04c4a8a5-098f-49af-9065-075d8323862e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.162578 Sep 13 15:35:24.957602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 404/597] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:24 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:25.981530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:25.982230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:25.984472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:25.990233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:25.990716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:25.991149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:25.991838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:25.992293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:25.992719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:26.141309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:26.154140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1bb5a6f8-f05c-49a4-91b7-04280e2c1a16 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1734 microversion: 2.1 time: 0.176341 Sep 13 15:35:26.154905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 405/598] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:25 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:27.183114 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:27.184161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:27.193041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.193524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.193955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.194712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.195142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.195564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.334149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:27.348374 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f34fb929-0c20-42cf-a322-85a9ac7b4760 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1714 microversion: 2.1 time: 0.171633 Sep 13 15:35:27.349105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 406/599] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:27 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1714 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:27.420618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:27.421140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:27.427616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.428105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.428533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.429227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.429692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.430095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.515350 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] HTTP exception thrown: Cannot 'detach_volume' instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 while it is in vm_state rescued Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Request method failure captured: Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments/f27dfa1d-8c9d-4efa-886d-8ace98e875fc HTTP/1.1 Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDu5gSlDj_2xS0l19tkew5jUPNXHSUDlZxnth8rcpscPiH0UQO2fdUlp9i-NCt2Jpx5NpR7etGwnPFFRH9fXozIirkXcNGhupSa4F53gx3DHtg5G5hpt0kPSKruQrtlKLVXKZeDyf7kEG9EcXzEWmRQoXDmea0r89AYjOoEaey2vs Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:35:27.517010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}] Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 97189d5c87c94be2bef7cff79c471c7d Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:35:27.518863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Cannot 'detach_volume' instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 while it is in vm_state rescued Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'server_id': '0782cb8b-a07b-4d5c-8014-23397c7d38c1', 'id': 'f27dfa1d-8c9d-4efa-886d-8ace98e875fc'} Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:35:27.519562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 while it is in vm_state rescued Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 while it is in vm_state rescued Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:35:27.520828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Returning 409 to user: Cannot 'detach_volume' instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 while it is in vm_state rescued {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:35:27.521820 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c71112f9-4425-48d5-8282-0bf807921aee tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments/f27dfa1d-8c9d-4efa-886d-8ace98e875fc" status: 409 len: 152 microversion: 2.1 time: 0.102849 Sep 13 15:35:27.521820 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 407/600] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:35:27 2022] DELETE /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments/f27dfa1d-8c9d-4efa-886d-8ace98e875fc => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 15:35:27.527674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:35:27.528196 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:27.534071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.534589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.535013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.535698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.536146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.536558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.606516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-82315008-66ea-4b4c-91a7-c9a458fdcbed tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "POST /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/action" status: 202 len: 0 microversion: 2.1 time: 0.082143 Sep 13 15:35:27.607118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 408/601] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:35:27 2022] POST /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:35:27.615672 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:27.616350 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:27.622476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.622969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.623526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.624171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:27.624629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:27.625121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:27.762587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:27.771269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-29f869bd-47f7-4876-a42b-bf8a91d16c93 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1722 microversion: 2.1 time: 0.159647 Sep 13 15:35:27.771844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 409/602] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:27 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:35:28.799055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:28.800161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:28.807293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:28.807785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:28.808222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:28.808927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:28.809383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:28.809817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:28.946534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:28.955343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-387597c6-d379-4650-a233-1257cbd0235c tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1722 microversion: 2.1 time: 0.163310 Sep 13 15:35:28.955924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 410/603] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:28 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:35:29.988115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:29.989170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:29.996147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:29.996635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:29.997064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:29.997754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:29.998308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:29.998732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:30.134305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:30.143160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7cf76cbe-eb15-4342-a9ff-68b9629c4a04 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1722 microversion: 2.1 time: 0.161940 Sep 13 15:35:30.143721 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 411/604] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:29 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:31.169376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:31.170223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:31.177857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:31.178605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:31.179110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:31.179924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:31.180448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:31.180939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:31.313414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:31.326508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3c26bc2c-5dee-4a2c-a67c-d4a44fba835b tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1722 microversion: 2.1 time: 0.162018 Sep 13 15:35:31.327367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 412/605] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:31 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:32.354955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:32.356092 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:32.365967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:32.366522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:32.366962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:32.367676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:32.368138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:32.368561 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:32.503914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:35:32.512763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1acebfb3-5730-4f56-96d2-e523ab16035e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1728 microversion: 2.1 time: 0.164480 Sep 13 15:35:32.513349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 413/606] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:35:32 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:35:32.535423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:32.535953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:32.542154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:32.542681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:32.543119 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:32.543830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:32.544291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:32.544719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:32.632846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2afaabda-726c-4c44-a98e-387868735a98 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101041 Sep 13 15:35:32.633483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 414/607] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:35:32 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:35:32.705071 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:35:32.705594 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:35:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:35:33.856072 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-eba067c4-829e-4db3-b463-27008292cadc req-50040303-c213-4b0a-b045-07aa17728ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0782cb8b-a07b-4d5c-8014-23397c7d38c1", "tag": "a5830845-c6ca-471c-ae1c-f8508ae26cc3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:35:33.866334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-eba067c4-829e-4db3-b463-27008292cadc req-50040303-c213-4b0a-b045-07aa17728ac3 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:33.866813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-eba067c4-829e-4db3-b463-27008292cadc req-50040303-c213-4b0a-b045-07aa17728ac3 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:33.867252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-eba067c4-829e-4db3-b463-27008292cadc req-50040303-c213-4b0a-b045-07aa17728ac3 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:33.879462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-eba067c4-829e-4db3-b463-27008292cadc req-50040303-c213-4b0a-b045-07aa17728ac3 service nova] Creating event network-changed:a5830845-c6ca-471c-ae1c-f8508ae26cc3 for instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 on hv-cinder-85743 Sep 13 15:35:33.886400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-eba067c4-829e-4db3-b463-27008292cadc req-50040303-c213-4b0a-b045-07aa17728ac3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095870 Sep 13 15:35:33.887205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 415/608] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:35:35.907158 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-2f0bee62-d838-4aec-b2aa-21e831acb292 req-7a30efca-019a-4a1a-837b-2c44f6a06308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0782cb8b-a07b-4d5c-8014-23397c7d38c1", "tag": "a5830845-c6ca-471c-ae1c-f8508ae26cc3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:35:35.918735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2f0bee62-d838-4aec-b2aa-21e831acb292 req-7a30efca-019a-4a1a-837b-2c44f6a06308 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:35.919332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2f0bee62-d838-4aec-b2aa-21e831acb292 req-7a30efca-019a-4a1a-837b-2c44f6a06308 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:35.919828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2f0bee62-d838-4aec-b2aa-21e831acb292 req-7a30efca-019a-4a1a-837b-2c44f6a06308 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:35.932470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-2f0bee62-d838-4aec-b2aa-21e831acb292 req-7a30efca-019a-4a1a-837b-2c44f6a06308 service nova] Creating event network-changed:a5830845-c6ca-471c-ae1c-f8508ae26cc3 for instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 on hv-cinder-85743 Sep 13 15:35:35.937488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-2f0bee62-d838-4aec-b2aa-21e831acb292 req-7a30efca-019a-4a1a-837b-2c44f6a06308 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036354 Sep 13 15:35:35.938593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 416/609] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:35:58.676237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=23 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:58.677068 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:35:58.781647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:58.782290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:58.788714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:58.789165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:58.789594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:58.790319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:58.790771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:58.791191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:58.821315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3dbafd3d-b316-4821-a778-f77894fd73c5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments/9960a421-8040-42fb-860c-9da567751a8e" status: 200 len: 194 microversion: 2.20 time: 0.152897 Sep 13 15:35:58.828705 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 417/610] 10.222.0.16 () {60 vars in 1454 bytes} [Tue Sep 13 15:35:58 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments/9960a421-8040-42fb-860c-9da567751a8e => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:35:58.895154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:58.895658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:58.902593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:58.903001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:58.903439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:58.904337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:58.904923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:58.905354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:58.987357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lazy-loading 'services' on Instance uuid 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:35:59.062090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ff6b0212-4e07-4363-a3e2-598a0710e7cd tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments/9960a421-8040-42fb-860c-9da567751a8e" status: 202 len: 0 microversion: 2.20 time: 0.170854 Sep 13 15:35:59.062739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 418/611] 10.222.0.16 () {60 vars in 1457 bytes} [Tue Sep 13 15:35:58 2022] DELETE /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments/9960a421-8040-42fb-860c-9da567751a8e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:35:59.071466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:35:59.074116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:35:59.080426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:59.081115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:59.081663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:59.082455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:35:59.082888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:35:59.083343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:35:59.114094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2f32dd35-c28a-4bd3-babd-12d0b43ac530 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046752 Sep 13 15:35:59.114685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 419/612] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 13 15:35:59 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 15:36:00.126621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:00.128762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:00.135699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:00.136159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:00.136591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:00.137292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:00.137739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:00.138180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:00.168310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0ddd221f-8afb-4d44-bafc-6c87d80c7cfa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046107 Sep 13 15:36:00.168857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 420/613] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 13 15:36:00 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:00.245148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:00.245630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:00.252668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:00.253083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:00.253507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:00.254228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:00.254678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:00.255094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:00.280540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:00.365437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-60218c22-4f87-4fce-9c8d-fe21f8930311 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 204 len: 0 microversion: 2.20 time: 0.123932 Sep 13 15:36:00.366583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 421/614] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 13 15:36:00 2022] DELETE /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 15:36:00.378463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:00.379555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:00.388609 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:00.389414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:00.390058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:00.391129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:00.391812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:00.392439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:00.547061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:00.555867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:00.557289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:00.558467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c9acaa66-2331-4aa5-b615-8508a24d862f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.186692 Sep 13 15:36:00.559033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 422/615] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:00 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:36:01.588344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:01.589375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:01.597650 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:01.598134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:01.598589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:01.599279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:01.599725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:01.600141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:01.734726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:01.742910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:01.744346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:01.745504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-34145661-297f-4e3a-9792-3d525ca2bfb2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.164383 Sep 13 15:36:01.746049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 423/616] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:01 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:02.773014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:02.773780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:02.781192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:02.781701 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:02.782135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:02.782927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:02.783335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:02.783762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:02.927478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:02.936482 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:02.937955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:02.939249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0d07d83d-1352-4652-b5b5-093cf9e18188 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 200 len: 1724 microversion: 2.20 time: 0.171318 Sep 13 15:36:02.939811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 424/617] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:02 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:03.246037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-a8d257b9-84bd-4510-bf37-2b0f3a66540d req-d2f050e4-5b41-444f-93fa-da8c45eb8e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b86fc1-70f9-4cbe-a998-ec6aef1ba750", "name": "network-vif-deleted", "tag": "7f6adc72-52bc-432c-b1c8-d041a0a6fe1b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:03.264837 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a8d257b9-84bd-4510-bf37-2b0f3a66540d req-d2f050e4-5b41-444f-93fa-da8c45eb8e3c service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:03.265326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a8d257b9-84bd-4510-bf37-2b0f3a66540d req-d2f050e4-5b41-444f-93fa-da8c45eb8e3c service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:03.265757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a8d257b9-84bd-4510-bf37-2b0f3a66540d req-d2f050e4-5b41-444f-93fa-da8c45eb8e3c service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:03.278257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-a8d257b9-84bd-4510-bf37-2b0f3a66540d req-d2f050e4-5b41-444f-93fa-da8c45eb8e3c service nova] Creating event network-vif-deleted:7f6adc72-52bc-432c-b1c8-d041a0a6fe1b for instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 on hv-cinder-85743 Sep 13 15:36:03.284374 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-a8d257b9-84bd-4510-bf37-2b0f3a66540d req-d2f050e4-5b41-444f-93fa-da8c45eb8e3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102928 Sep 13 15:36:03.290449 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 425/618] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:03.968141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:03.969519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:03.976023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:03.976602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:03.977114 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:03.977883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:03.980835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:03.981542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:03.998008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] HTTP exception thrown: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Request method failure captured: Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 HTTP/1.1 Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDXvXGOUw2ns5FLwVJB2FAPvBHVwq_1JlHsSi7AVAZKhzUu7763YnAb_HYxZBy65-Zqk0GX0-3_YVg0AUVn0YXCMZsmTRR2WwKQUgAlsVKs8tVhEPFhT4snbuEwplXDAEB0iNQ-MmYcRW14LVzITf7rP0gFVPfKyxmnUX_Jkzs7tA Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:03.999960 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}] Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 515e0f8a3a234deba5f909271b303abb Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:36:04.001467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '34b86fc1-70f9-4cbe-a998-ec6aef1ba750'} Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:04.002634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:36:04.004144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:04.005529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Returning 404 to user: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:04.005529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e28eacc1-b9a3-4b9d-a974-372263a61bbf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 404 len: 111 microversion: 2.20 time: 0.039867 Sep 13 15:36:04.005529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 426/619] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:03 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 15:36:04.010831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-07e54430-83c0-436f-b06f-3021022698d3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '.version_select at 0x7f4bbf6375e0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:04.032423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-07e54430-83c0-436f-b06f-3021022698d3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718268037" status: 204 len: 0 microversion: 2.20 time: 0.025591 Sep 13 15:36:04.033003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 427/620] 10.222.0.16 () {60 vars in 1262 bytes} [Tue Sep 13 15:36:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718268037 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 15:36:04.718249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-93951021-cc2d-4bbf-9b7b-00ede77c8255 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'create', calling method: .version_select at 0x7f4bbf4ad4c0>, body: {"keypair": {"name": "tempest-keypair-515779821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWNK8rKtHxmODBj9tUC1XPF1c83HRWdaleYK1kAKLAoIMIlsljBZWot6PjhQ93jkn77/3bTHrTdkPNcSHLDjsAJUJkQUDLdEgmZLp5m1jCI6oZITuEDFQOldDC/q8icpA=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:04.734691 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-93951021-cc2d-4bbf-9b7b-00ede77c8255 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:36:04.738679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-93951021-cc2d-4bbf-9b7b-00ede77c8255 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for user 515e0f8a3a234deba5f909271b303abb and project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:36:04.764292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-93951021-cc2d-4bbf-9b7b-00ede77c8255 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050053 Sep 13 15:36:04.765828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 428/621] 10.222.0.16 () {62 vars in 1200 bytes} [Tue Sep 13 15:36:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 15:36:06.088463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1276614108", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a87f0b4-b557-4ae0-99ca-c1b34aa8ea5c"}], "security_groups": [{"name": "tempest-securitygroup--176316599"}], "key_name": "tempest-keypair-515779821", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:06.193687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] validate_networks() for [('0a87f0b4-b557-4ae0-99ca-c1b34aa8ea5c', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:36:06.635097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:36:06.635716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:36:06.636332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:36:06.636935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:36:06.637579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:36:06.648683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:06.649169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:06.649599 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:06.650364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:06.650814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:06.651210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:06.668562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:36:06.673123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Getting quotas for user 515e0f8a3a234deba5f909271b303abb and project 3cbf0c034dd54a8d856d9bc6fb485b45. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:36:06.685332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:36:06.688331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:36:06.744940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-56fcc18a-baa4-4593-b60e-e7d90cbb2634 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.661615 Sep 13 15:36:06.745472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 429/622] 10.222.0.16 () {62 vars in 1188 bytes} [Tue Sep 13 15:36:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 15:36:06.756789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-944a0487-a7b8-4ec7-ac23-67b12c541dc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:06.757434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-944a0487-a7b8-4ec7-ac23-67b12c541dc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:06.813041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-944a0487-a7b8-4ec7-ac23-67b12c541dc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:06.820676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-944a0487-a7b8-4ec7-ac23-67b12c541dc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:06.822150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-944a0487-a7b8-4ec7-ac23-67b12c541dc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:06.823263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-944a0487-a7b8-4ec7-ac23-67b12c541dc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1281 microversion: 2.20 time: 0.070329 Sep 13 15:36:06.823817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 430/623] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:06 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:07.849427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:07.850016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:07.856187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:07.856670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:07.857128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:07.857809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:07.858306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:07.858722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:07.922744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:07.931262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:07.932679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:07.933770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ba96e3d8-0d30-4a5b-9f19-630c75f67888 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1333 microversion: 2.20 time: 0.088593 Sep 13 15:36:07.934354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 431/624] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:07 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:08.959235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:08.959916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:08.966525 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:08.967005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:08.967431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:08.968166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:08.968615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:08.969039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:09.176006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:09.185168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:09.187021 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:09.188446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8e8da51d-acd5-49c5-a18c-6637aa4ebaeb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.233567 Sep 13 15:36:09.189128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 432/625] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:08 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:09.847323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-fde1db7d-4c45-48cf-890d-bb568356735c req-e850d16e-ee18-40ed-9176-2ab9753cb571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ca18ccd-bba6-4f59-ac3a-61e4524607f0", "tag": "5a5700cd-ed56-489f-9724-206efe586022"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:09.858748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fde1db7d-4c45-48cf-890d-bb568356735c req-e850d16e-ee18-40ed-9176-2ab9753cb571 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:09.859397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fde1db7d-4c45-48cf-890d-bb568356735c req-e850d16e-ee18-40ed-9176-2ab9753cb571 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:09.859947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fde1db7d-4c45-48cf-890d-bb568356735c req-e850d16e-ee18-40ed-9176-2ab9753cb571 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:09.871636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-fde1db7d-4c45-48cf-890d-bb568356735c req-e850d16e-ee18-40ed-9176-2ab9753cb571 service nova] Creating event network-changed:5a5700cd-ed56-489f-9724-206efe586022 for instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 on hv-cinder-85743 Sep 13 15:36:09.876733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-fde1db7d-4c45-48cf-890d-bb568356735c req-e850d16e-ee18-40ed-9176-2ab9753cb571 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Sep 13 15:36:09.877401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 433/626] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:10.215695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:10.216366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:10.222898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:10.223383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:10.223814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:10.224536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:10.224982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:10.225397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:10.370833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:10.379249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:10.380696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:10.381815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-17cb76bd-1378-43cb-834c-27e30a67aaad tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.171005 Sep 13 15:36:10.382413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 434/627] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:10 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:11.407107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:11.407580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:11.414519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:11.415007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:11.415436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:11.416129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:11.416584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:11.417004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:11.555748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:11.569077 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:11.571374 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:11.573091 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b8cf2833-2c98-4b8e-a932-bc3077a2ed06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.170031 Sep 13 15:36:11.573922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 435/628] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:11 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:12.605676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:12.606778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:12.617789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:12.618649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:12.619375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:12.620522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:12.621301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:12.622004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:12.756329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:12.761748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:12.769624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:12.771942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:12.773552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dba8039d-97b3-4adc-901e-80858107b602 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.174359 Sep 13 15:36:12.774345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 436/629] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:12 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:13.801995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:13.802804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:13.810121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:13.810616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:13.811038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:13.811729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:13.812172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:13.812583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:13.946866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:13.956707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:13.958511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:13.959660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-66f598fa-dec9-403f-8b9c-cba52d23f270 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.162222 Sep 13 15:36:13.960217 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 437/630] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:13 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:36:14.989637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:14.990781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:15.001778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:15.002333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:15.002770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:15.003471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:15.003949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:15.004410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:15.385402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:15.396536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:15.397981 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:15.399125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-53604a82-ddc0-426a-a51a-dc512fde3cc2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.416191 Sep 13 15:36:15.399651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 438/631] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:14 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:16.198759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-4c4310ed-0112-4ac7-b742-fb39db8617cd req-c6255dcb-817b-4fbd-826f-c29cb8a30984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca18ccd-bba6-4f59-ac3a-61e4524607f0", "name": "network-vif-plugged", "status": "completed", "tag": "5a5700cd-ed56-489f-9724-206efe586022"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:16.210152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4c4310ed-0112-4ac7-b742-fb39db8617cd req-c6255dcb-817b-4fbd-826f-c29cb8a30984 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:16.210636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4c4310ed-0112-4ac7-b742-fb39db8617cd req-c6255dcb-817b-4fbd-826f-c29cb8a30984 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:16.211057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4c4310ed-0112-4ac7-b742-fb39db8617cd req-c6255dcb-817b-4fbd-826f-c29cb8a30984 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:16.224199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-4c4310ed-0112-4ac7-b742-fb39db8617cd req-c6255dcb-817b-4fbd-826f-c29cb8a30984 service nova] Creating event network-vif-plugged:5a5700cd-ed56-489f-9724-206efe586022 for instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 on hv-cinder-85743 Sep 13 15:36:16.229191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-4c4310ed-0112-4ac7-b742-fb39db8617cd req-c6255dcb-817b-4fbd-826f-c29cb8a30984 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091136 Sep 13 15:36:16.229917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 439/632] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:16.424977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:16.425706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:16.432342 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:16.432828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:16.433491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:16.434215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:16.434854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:16.435039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:16.575196 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:16.584381 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:16.586458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:16.587575 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3c0f8dfb-fa37-45b1-9809-bea1098c1bb0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.167033 Sep 13 15:36:16.588146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 440/633] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:16 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:17.617493 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:17.618392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:17.620976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:17.621898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=12 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:17.631100 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:17.631798 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:17.632400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:17.633308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:17.633903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:17.634514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:17.775129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:17.783318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:17.785459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:17.786616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a4435966-8a0d-4757-a696-78bd0d3db885 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1406 microversion: 2.20 time: 0.176116 Sep 13 15:36:17.787170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 441/634] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:17 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:18.816422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:18.817101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:18.823844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:18.824330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:18.824765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:18.825458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:18.825914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:18.826370 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:18.964749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:18.973029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:18.974508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:18.975664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b1222755-9b5c-469d-aac4-7c77262a3baa tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1599 microversion: 2.20 time: 0.165911 Sep 13 15:36:18.976197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 442/635] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:36:18 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:36:19.000019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:19.000509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:19.006778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:19.007266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:19.007703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:19.008369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:19.008822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:19.009246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:19.088890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-01f2539b-27e1-4e50-8bff-0c81f076d191 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092131 Sep 13 15:36:19.089710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 443/636] 10.222.0.16 () {60 vars in 1316 bytes} [Tue Sep 13 15:36:18 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:36:20.308869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-ae2f2a31-2c21-490d-89a4-928db9c69ba3 req-28bef05a-6b9b-48db-b2f6-114db6db719f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ca18ccd-bba6-4f59-ac3a-61e4524607f0", "tag": "5a5700cd-ed56-489f-9724-206efe586022"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:20.319762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ae2f2a31-2c21-490d-89a4-928db9c69ba3 req-28bef05a-6b9b-48db-b2f6-114db6db719f service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:20.320238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ae2f2a31-2c21-490d-89a4-928db9c69ba3 req-28bef05a-6b9b-48db-b2f6-114db6db719f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:20.320659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ae2f2a31-2c21-490d-89a4-928db9c69ba3 req-28bef05a-6b9b-48db-b2f6-114db6db719f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:20.332459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-ae2f2a31-2c21-490d-89a4-928db9c69ba3 req-28bef05a-6b9b-48db-b2f6-114db6db719f service nova] Creating event network-changed:5a5700cd-ed56-489f-9724-206efe586022 for instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 on hv-cinder-85743 Sep 13 15:36:20.337982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-ae2f2a31-2c21-490d-89a4-928db9c69ba3 req-28bef05a-6b9b-48db-b2f6-114db6db719f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035501 Sep 13 15:36:20.338828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 444/637] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:22.258076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-311192734"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:22.258814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:22.265785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:22.266315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:22.266747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:22.267438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:22.267882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:22.268571 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:22.410194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.network.security_group_api [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Removing security group 2629fab4-a835-4c4c-8f72-0dd82071acbd from port ac7865ed-3013-45da-bc75-391a25c58cca Sep 13 15:36:22.767132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6a77b8df-0db8-4ca3-a76a-4557769848d3 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/action" status: 202 len: 0 microversion: 2.1 time: 0.513356 Sep 13 15:36:22.769241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 445/638] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:36:22 2022] POST /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:22.778021 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-b32292e1-8620-4b58-918f-af0cb25bad65 req-f8488039-0611-4088-98b0-9e1ab50d6184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b061df6a-e663-49b1-baec-e555aa59534c", "tag": "ac7865ed-3013-45da-bc75-391a25c58cca"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:22.788760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b32292e1-8620-4b58-918f-af0cb25bad65 req-f8488039-0611-4088-98b0-9e1ab50d6184 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:22.789248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b32292e1-8620-4b58-918f-af0cb25bad65 req-f8488039-0611-4088-98b0-9e1ab50d6184 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:22.789679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b32292e1-8620-4b58-918f-af0cb25bad65 req-f8488039-0611-4088-98b0-9e1ab50d6184 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:22.802139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-b32292e1-8620-4b58-918f-af0cb25bad65 req-f8488039-0611-4088-98b0-9e1ab50d6184 service nova] Creating event network-changed:ac7865ed-3013-45da-bc75-391a25c58cca for instance b061df6a-e663-49b1-baec-e555aa59534c on hv-cinder-85743 Sep 13 15:36:22.807564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-b32292e1-8620-4b58-918f-af0cb25bad65 req-f8488039-0611-4088-98b0-9e1ab50d6184 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033309 Sep 13 15:36:22.808349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 446/639] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:23.064347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:23.065118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:23.072907 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.073517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.073889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.074671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.075211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.075638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.102630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-23bcc793-cd8a-42ed-83bc-50c911c72da3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217/ips" status: 200 len: 151 microversion: 2.1 time: 0.042773 Sep 13 15:36:23.103536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 447/640] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:36:23 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:23.116444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd7658f5-c096-4bbb-9181-c8cabbae5a61"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:23.118931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:23.122144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:23.125611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.126089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.126551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.127244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.127793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.128212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.221195 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Invalid volume: volume dd7658f5-c096-4bbb-9181-c8cabbae5a61 is already attached to instances: 2ec25cef-3608-4af4-a0ff-119c601b2cb2 Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: POST /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217/os-volume_attachments HTTP/1.1 Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 74 Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:23.223649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {"volumeAttachment": {"volumeId": "dd7658f5-c096-4bbb-9181-c8cabbae5a61"}} Sep 13 15:36:23.225142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Invalid volume: volume dd7658f5-c096-4bbb-9181-c8cabbae5a61 is already attached to instances: 2ec25cef-3608-4af4-a0ff-119c601b2cb2 Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'server_id': 'fef3959b-a730-4f58-95ac-f15f415f8217', 'body': {'volumeAttachment': {'volumeId': 'dd7658f5-c096-4bbb-9181-c8cabbae5a61'}}} Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd7658f5-c096-4bbb-9181-c8cabbae5a61 is already attached to instances: 2ec25cef-3608-4af4-a0ff-119c601b2cb2 Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:23.226030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd7658f5-c096-4bbb-9181-c8cabbae5a61 is already attached to instances: 2ec25cef-3608-4af4-a0ff-119c601b2cb2 Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:23.227501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd7658f5-c096-4bbb-9181-c8cabbae5a61 is already attached to instances: 2ec25cef-3608-4af4-a0ff-119c601b2cb2 Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 400 to user: Invalid volume: volume dd7658f5-c096-4bbb-9181-c8cabbae5a61 is already attached to instances: 2ec25cef-3608-4af4-a0ff-119c601b2cb2 {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3ea205e9-2cfb-43b3-870a-481bbf0622ad tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113785 Sep 13 15:36:23.228994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 448/641] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:36:23 2022] POST /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 15:36:23.233888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:23.234414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:23.240757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.241315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.241742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.242453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.242908 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.243338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.269589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:23.353108 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d4a34031-1255-411b-b23b-d6d2a9c245e4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 204 len: 0 microversion: 2.1 time: 0.122376 Sep 13 15:36:23.353782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 449/642] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:36:23 2022] DELETE /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:36:23.365162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:23.365874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:23.372083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.372646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.373141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.373907 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:23.374536 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:23.375141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:23.556652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:23.564386 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e9421eb3-ec05-463e-ab12-a7b7c3d4053a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1681 microversion: 2.1 time: 0.204767 Sep 13 15:36:23.565022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 450/643] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:23 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:24.057031 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:24.057531 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:24.063693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:24.064170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:24.064591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:24.065607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:24.066069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:24.066516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:24.147940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lazy-loading 'services' on Instance uuid b061df6a-e663-49b1-baec-e555aa59534c {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:24.227045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-18ce6408-e95b-4ce4-a38a-e368b1f12003 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments/d1cae36e-e01c-4b31-81fb-a750e2127092" status: 202 len: 0 microversion: 2.1 time: 0.173811 Sep 13 15:36:24.227630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 451/644] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:36:24 2022] DELETE /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments/d1cae36e-e01c-4b31-81fb-a750e2127092 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:24.236373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:24.239026 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:24.245322 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:24.245805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:24.246277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:24.246973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:24.247417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:24.247831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:24.277682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d4ed89bb-fc18-41b4-8a24-e49cb1ffd733 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Sep 13 15:36:24.278363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 452/645] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:24 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:24.588635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:24.589660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:24.597101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:24.597868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:24.598542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:24.599788 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:24.600396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:24.601011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:24.795442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:24.803570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3572c504-984b-4749-961e-07920e6b5d7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1681 microversion: 2.1 time: 0.219095 Sep 13 15:36:24.804136 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 453/646] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:24 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:24.824118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-f0ec0d03-1d66-449e-9ead-f1878ca0a869 req-1840d51d-9e8f-4d4a-956a-75c1cda8c204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b061df6a-e663-49b1-baec-e555aa59534c", "tag": "ac7865ed-3013-45da-bc75-391a25c58cca"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:24.835676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f0ec0d03-1d66-449e-9ead-f1878ca0a869 req-1840d51d-9e8f-4d4a-956a-75c1cda8c204 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:24.836270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f0ec0d03-1d66-449e-9ead-f1878ca0a869 req-1840d51d-9e8f-4d4a-956a-75c1cda8c204 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:24.836882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f0ec0d03-1d66-449e-9ead-f1878ca0a869 req-1840d51d-9e8f-4d4a-956a-75c1cda8c204 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:24.841378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:24.850134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-f0ec0d03-1d66-449e-9ead-f1878ca0a869 req-1840d51d-9e8f-4d4a-956a-75c1cda8c204 service nova] Creating event network-changed:ac7865ed-3013-45da-bc75-391a25c58cca for instance b061df6a-e663-49b1-baec-e555aa59534c on hv-cinder-85743 Sep 13 15:36:24.855210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-f0ec0d03-1d66-449e-9ead-f1878ca0a869 req-1840d51d-9e8f-4d4a-956a-75c1cda8c204 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034725 Sep 13 15:36:24.855790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 454/647] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:25.294917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:25.297521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:25.306347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:25.306877 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:25.307421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:25.308238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:25.308931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:25.309427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:25.345178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d4a558be-3b09-4a30-8b03-9cf26ae0e16f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056610 Sep 13 15:36:25.346440 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 455/648] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:25 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:25.828274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:25.829048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:25.836141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:25.836741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:25.837339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:25.838197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:25.838791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:25.839430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:26.209891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:26.217812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-52c2ff1c-7def-4a4a-8fc0-791e9139d913 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1681 microversion: 2.1 time: 0.393713 Sep 13 15:36:26.218385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 456/649] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:25 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1681 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:26.359780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:26.362230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:26.369141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:26.369634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:26.370047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:26.370911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:26.371377 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:26.371793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:26.402991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b4a21eeb-a88e-4cfe-9b1f-f2585a87f84f tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047261 Sep 13 15:36:26.403582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 457/650] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:26 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:36:26.414423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:26.414423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:26.420611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:26.421090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:26.421516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:26.422241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:26.422685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:26.423090 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:26.508107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] HTTP exception thrown: Instance b061df6a-e663-49b1-baec-e555aa59534c is not attached to volume d1cae36e-e01c-4b31-81fb-a750e2127092 Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Request method failure captured: Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments/d1cae36e-e01c-4b31-81fb-a750e2127092 HTTP/1.1 Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKKAOIgzAgOcycvheaU_XBNO-XtbIoKD3HlrBKWjpraUGEphTMaEhMv6cyOPs6N55LDNt3YHNP55_akokMyz0g9IbcEjj1ubksehRC0c5_QVRpySMabvyFEpR4BhuURGIAtext9eAmKz3swuHxW3OAAjdxVfKxtvJHEj2OeHfOx4YlE Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 74318a6f074f4d7ea084461473ef1a80 Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-TestMinimumBasicScenario-1566828925 Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:26.514811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74318a6f074f4d7ea084461473ef1a80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74318a6f074f4d7ea084461473ef1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74318a6f074f4d7ea084461473ef1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74318a6f074f4d7ea084461473ef1a80"}]}] Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-TestMinimumBasicScenario-1566828925 Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 74318a6f074f4d7ea084461473ef1a80 Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1566828925 Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-TestMinimumBasicScenario-1566828925-project Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 0815b4e3389240ada8d1c55941aca8cf Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-TestMinimumBasicScenario-1566828925-project Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:26.516456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance b061df6a-e663-49b1-baec-e555aa59534c is not attached to volume d1cae36e-e01c-4b31-81fb-a750e2127092 Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'server_id': 'b061df6a-e663-49b1-baec-e555aa59534c', 'id': 'd1cae36e-e01c-4b31-81fb-a750e2127092'} Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d1cae36e-e01c-4b31-81fb-a750e2127092. Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:26.517330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b061df6a-e663-49b1-baec-e555aa59534c is not attached to volume d1cae36e-e01c-4b31-81fb-a750e2127092 Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b061df6a-e663-49b1-baec-e555aa59534c is not attached to volume d1cae36e-e01c-4b31-81fb-a750e2127092 Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:26.523113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Returning 404 to user: Instance b061df6a-e663-49b1-baec-e555aa59534c is not attached to volume d1cae36e-e01c-4b31-81fb-a750e2127092 {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:26.524263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c44fd85a-06d4-4f33-a2ed-03d3f172aa6e tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments/d1cae36e-e01c-4b31-81fb-a750e2127092" status: 404 len: 154 microversion: 2.1 time: 0.107857 Sep 13 15:36:26.524263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 458/651] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:36:26 2022] DELETE /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c/os-volume_attachments/d1cae36e-e01c-4b31-81fb-a750e2127092 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:36:26.872064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-6fb3072a-7136-4828-b3f3-7aabb1aba9ba req-cfcdc5c8-af59-4d62-aca9-09a28010daca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef3959b-a730-4f58-95ac-f15f415f8217", "name": "network-vif-deleted", "tag": "454b128f-b9b2-4847-bdbf-f828f42cd0da"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:26.883236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-6fb3072a-7136-4828-b3f3-7aabb1aba9ba req-cfcdc5c8-af59-4d62-aca9-09a28010daca service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:26.883903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-6fb3072a-7136-4828-b3f3-7aabb1aba9ba req-cfcdc5c8-af59-4d62-aca9-09a28010daca service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:26.884433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-6fb3072a-7136-4828-b3f3-7aabb1aba9ba req-cfcdc5c8-af59-4d62-aca9-09a28010daca service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:26.899186 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-6fb3072a-7136-4828-b3f3-7aabb1aba9ba req-cfcdc5c8-af59-4d62-aca9-09a28010daca service nova] Creating event network-vif-deleted:454b128f-b9b2-4847-bdbf-f828f42cd0da for instance fef3959b-a730-4f58-95ac-f15f415f8217 on hv-cinder-85743 Sep 13 15:36:26.905098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-6fb3072a-7136-4828-b3f3-7aabb1aba9ba req-cfcdc5c8-af59-4d62-aca9-09a28010daca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037509 Sep 13 15:36:26.906066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 459/652] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:27.244202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:27.244941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:27.252771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:27.253343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:27.253848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:27.254790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:27.255122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:27.255465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:27.297126 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:27.297715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:27.298189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:27.298639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lazy-loading 'fault' on Instance uuid fef3959b-a730-4f58-95ac-f15f415f8217 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:27.349688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:27.358815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6eebc11c-40e2-478b-b774-c9ec3e178089 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 200 len: 1331 microversion: 2.1 time: 0.118631 Sep 13 15:36:27.359498 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 460/653] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:27 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:27.711099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:27.711725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:27.718953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:27.719437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:27.720003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:27.720868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:27.721508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:27.721941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:27.747856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:27.831626 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f51d3a56-3907-4f52-ad0e-3ba6ad268ba6 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 204 len: 0 microversion: 2.1 time: 0.124501 Sep 13 15:36:27.832218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 461/654] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:36:27 2022] DELETE /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:36:27.841116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:27.841816 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:27.848019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:27.848507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:27.848944 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:27.849650 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:27.850122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:27.850578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:27.996831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:28.005027 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4e58dbba-cf01-4700-9c62-34a2e50b7d67 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1554 microversion: 2.1 time: 0.168003 Sep 13 15:36:28.005641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 462/655] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:27 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:28.383933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:28.384439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:28.391363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:28.391874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:28.392303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:28.393038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:28.393482 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:28.393902 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:28.407430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 HTTP/1.1 Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:28.409162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:36:28.410654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': 'fef3959b-a730-4f58-95ac-f15f415f8217'} Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:28.411532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:36:28.412925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:28.414261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:28.414261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1b09c142-69c8-409a-8cf7-88af2a442144 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 404 len: 111 microversion: 2.1 time: 0.030648 Sep 13 15:36:28.414261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 463/656] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:28 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:36:28.419345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6d444c05-3aef-4fb9-8c7c-475de33cd3d3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '.version_select at 0x7f4bbf688790>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:28.440930 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6d444c05-3aef-4fb9-8c7c-475de33cd3d3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240054041" status: 202 len: 0 microversion: 2.1 time: 0.025172 Sep 13 15:36:28.441531 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 464/657] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Sep 13 15:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240054041 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:29.029136 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:29.029765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:29.038744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:29.039238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:29.039670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:29.040455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:29.040904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:29.041307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:29.180923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:29.194092 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5bb34b23-92e3-4e23-bec3-1da76052ac64 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1554 microversion: 2.1 time: 0.169025 Sep 13 15:36:29.194924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 465/658] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:29 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:29.200699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:29.201188 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:29.207847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:29.208335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:29.208790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:29.209457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:29.209913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:29.210370 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:29.291338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lazy-loading 'services' on Instance uuid 2ec25cef-3608-4af4-a0ff-119c601b2cb2 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:29.371289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-03e5ecfd-3dcf-4910-8b91-52d8b017c837 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments/dd7658f5-c096-4bbb-9181-c8cabbae5a61" status: 202 len: 0 microversion: 2.1 time: 0.174114 Sep 13 15:36:29.371916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 466/659] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:36:29 2022] DELETE /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments/dd7658f5-c096-4bbb-9181-c8cabbae5a61 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:29.380615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:29.382967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:29.389114 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:29.389613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:29.390050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:29.390781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:29.391236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:29.391659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:29.425019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f028df6e-0b80-444e-aebf-5afd5fc91642 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048352 Sep 13 15:36:29.425629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 467/660] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:29 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:30.219916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:30.220674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:30.227981 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.228730 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.229164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.229867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.230350 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.230771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.469660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:30.479649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-494ca2e2-a57b-4a6f-95fc-ec4c736dc6de tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1554 microversion: 2.1 time: 0.264737 Sep 13 15:36:30.480205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 468/661] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:30 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:30.485048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:30.487611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:30.494878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.495568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.496305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.497175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.497658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.498091 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.531398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-88878ff7-6b25-486f-bf44-7be4247191c1 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050089 Sep 13 15:36:30.531971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 469/662] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:30 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:36:30.597865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:30.598392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:30.604370 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.604859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.605292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.605991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.606478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.606903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.631696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:30.646668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:30.723955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ebe9c673-ab7d-42c3-ac58-4570a569c38a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 204 len: 0 microversion: 2.1 time: 0.129846 Sep 13 15:36:30.724597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 470/663] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:36:30 2022] DELETE /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 15:36:30.734331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:30.734964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:30.741628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.742254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.742734 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.743528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.743990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.744418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.904863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:30.913312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1d575241-98c1-415d-8edd-2bbd05ed36b3 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1682 microversion: 2.1 time: 0.183549 Sep 13 15:36:30.913896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 471/664] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:30 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:30.918888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-32c3ab95-2bd5-42ea-a174-08fc000a4dc4 req-ace85ac6-0cfe-47eb-90a4-67c4ce105798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b061df6a-e663-49b1-baec-e555aa59534c", "name": "network-vif-deleted", "tag": "ac7865ed-3013-45da-bc75-391a25c58cca"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:30.928474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-32c3ab95-2bd5-42ea-a174-08fc000a4dc4 req-ace85ac6-0cfe-47eb-90a4-67c4ce105798 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:30.928939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-32c3ab95-2bd5-42ea-a174-08fc000a4dc4 req-ace85ac6-0cfe-47eb-90a4-67c4ce105798 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:30.929360 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-32c3ab95-2bd5-42ea-a174-08fc000a4dc4 req-ace85ac6-0cfe-47eb-90a4-67c4ce105798 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:30.940994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-32c3ab95-2bd5-42ea-a174-08fc000a4dc4 req-ace85ac6-0cfe-47eb-90a4-67c4ce105798 service nova] Creating event network-vif-deleted:ac7865ed-3013-45da-bc75-391a25c58cca for instance b061df6a-e663-49b1-baec-e555aa59534c on hv-cinder-85743 Sep 13 15:36:30.946617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-32c3ab95-2bd5-42ea-a174-08fc000a4dc4 req-ace85ac6-0cfe-47eb-90a4-67c4ce105798 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 Sep 13 15:36:30.947356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 472/665] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:31.265518 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:31.269046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:31.278532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.279186 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.279852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.280624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.281267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.281873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.313492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a0f71784-033d-4323-b04a-60a60c7109cc tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055888 Sep 13 15:36:31.314047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 473/666] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:31 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:36:31.386606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:31.387101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:31.393198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.393680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.394125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.394830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.395302 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.395691 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.420451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:31.500872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-417c9a46-cde0-4305-aa36-cff0a8884b59 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 204 len: 0 microversion: 2.1 time: 0.117972 Sep 13 15:36:31.501463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 474/667] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:36:31 2022] DELETE /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:36:31.506532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:31.507225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:31.512755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.513236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.513666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.514383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.514833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.515249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.587215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:31.595502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-57ed759b-cc0b-40bf-8f07-86f747599437 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1512 microversion: 2.1 time: 0.092945 Sep 13 15:36:31.596136 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 475/668] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:31 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:31.600581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:31.601178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:31.606891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.607382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.607804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.608504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.608940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.609356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.738088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:31.746248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b7efff9b-f033-461d-ac87-0fc527619870 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1672 microversion: 2.1 time: 0.149061 Sep 13 15:36:31.746824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 476/669] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:31 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:31.938718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:31.939463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:31.947479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.948087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.948637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:31.949502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:31.950062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:31.950716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:32.083760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:32.091598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-549a6ce8-4054-4df1-9fde-f84452b322f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1682 microversion: 2.1 time: 0.157893 Sep 13 15:36:32.092164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 477/670] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:31 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:32.620294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:32.621036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:32.628424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:32.629042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:32.629474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:32.630208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:32.630655 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:32.631048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:32.697152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:32.705497 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b6805ef8-ca30-41c3-9b0c-01fe68d38f4c tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1344 microversion: 2.1 time: 0.089020 Sep 13 15:36:32.706060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 478/671] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:32 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:32.774061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:32.775089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:32.784434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:32.784915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:32.785344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:32.786032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:32.786515 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:32.786931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:32.933507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:32.947738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-48d6f1a0-d009-40bd-8250-63a21445d296 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1672 microversion: 2.1 time: 0.179867 Sep 13 15:36:32.948507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 479/672] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:32 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:33.115225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:33.115820 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:33.122689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:33.123175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:33.123611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:33.124313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:33.124774 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:33.125201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:33.266577 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:33.274765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6c307298-6a9b-4c76-a7e1-69a8c91d1329 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1682 microversion: 2.1 time: 0.163522 Sep 13 15:36:33.275336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 480/673] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:33 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:33.730080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:33.733194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:33.742765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:33.743271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:33.743711 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:33.744482 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:33.745062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:33.745491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:33.782867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:33.783492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:33.783934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:33.784610 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lazy-loading 'fault' on Instance uuid b061df6a-e663-49b1-baec-e555aa59534c {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:33.840630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0815b4e3389240ada8d1c55941aca8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74318a6f074f4d7ea084461473ef1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:33.852120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3ba74993-c38c-485b-8287-4d31e2a89f6d tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 200 len: 1349 microversion: 2.1 time: 0.127084 Sep 13 15:36:33.853077 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 481/674] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:33 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 1349 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:33.980339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:33.984648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:34.009350 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.012605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.012996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.013737 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.014235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.016882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.258352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:34.267229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ecf9bbbb-0126-4a07-a9ab-de010f4a1560 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1672 microversion: 2.1 time: 0.290653 Sep 13 15:36:34.267897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 482/675] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:33 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1672 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:34.300607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:34.302006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:34.308115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:34.311753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.312419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.313215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.313539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.313990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.314493 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.406566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:34.418138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e47bebd7-4020-4a84-9d05-4004589973fc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 200 len: 1614 microversion: 2.1 time: 0.122781 Sep 13 15:36:34.419005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 483/676] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:34 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:34.439380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-6c22fe0f-d8c6-4c58-965f-765f4bfc36fa req-e5908536-8420-4a60-82f4-70da22fd895b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec25cef-3608-4af4-a0ff-119c601b2cb2", "name": "network-vif-deleted", "tag": "bf95274d-7cad-4bd2-aa20-8fe6600a24ff"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:34.449825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-6c22fe0f-d8c6-4c58-965f-765f4bfc36fa req-e5908536-8420-4a60-82f4-70da22fd895b service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.450341 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-6c22fe0f-d8c6-4c58-965f-765f4bfc36fa req-e5908536-8420-4a60-82f4-70da22fd895b service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.450768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-6c22fe0f-d8c6-4c58-965f-765f4bfc36fa req-e5908536-8420-4a60-82f4-70da22fd895b service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.464307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-6c22fe0f-d8c6-4c58-965f-765f4bfc36fa req-e5908536-8420-4a60-82f4-70da22fd895b service nova] Creating event network-vif-deleted:bf95274d-7cad-4bd2-aa20-8fe6600a24ff for instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 on hv-cinder-85743 Sep 13 15:36:34.470080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-6c22fe0f-d8c6-4c58-965f-765f4bfc36fa req-e5908536-8420-4a60-82f4-70da22fd895b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034157 Sep 13 15:36:34.471182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 484/677] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:34.647846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-4843abb2-5ec0-45e1-9a3c-3ddfb7dfa188 req-67bd703e-40ae-409c-b52e-8ba7a4ca5b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05da62b3-a8ec-4148-b17b-2c08f0e0d2ae", "name": "network-vif-deleted", "tag": "8c605c1b-be6e-4bf8-8d00-af61d57887b0"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:34.671299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4843abb2-5ec0-45e1-9a3c-3ddfb7dfa188 req-67bd703e-40ae-409c-b52e-8ba7a4ca5b27 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.672046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4843abb2-5ec0-45e1-9a3c-3ddfb7dfa188 req-67bd703e-40ae-409c-b52e-8ba7a4ca5b27 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.672704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4843abb2-5ec0-45e1-9a3c-3ddfb7dfa188 req-67bd703e-40ae-409c-b52e-8ba7a4ca5b27 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.690167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-4843abb2-5ec0-45e1-9a3c-3ddfb7dfa188 req-67bd703e-40ae-409c-b52e-8ba7a4ca5b27 service nova] Creating event network-vif-deleted:8c605c1b-be6e-4bf8-8d00-af61d57887b0 for instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae on hv-cinder-85743 Sep 13 15:36:34.698979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-4843abb2-5ec0-45e1-9a3c-3ddfb7dfa188 req-67bd703e-40ae-409c-b52e-8ba7a4ca5b27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061849 Sep 13 15:36:34.707869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 485/678] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:34.877439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:34.878377 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] [instance: b061df6a-e663-49b1-baec-e555aa59534c] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:34.884703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.885190 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.885655 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.886408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:34.886865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:34.887287 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:34.891518 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:34.902095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] HTTP exception thrown: Instance b061df6a-e663-49b1-baec-e555aa59534c could not be found. Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Request method failure captured: Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c HTTP/1.1 Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKKAOIgzAgOcycvheaU_XBNO-XtbIoKD3HlrBKWjpraUGEphTMaEhMv6cyOPs6N55LDNt3YHNP55_akokMyz0g9IbcEjj1ubksehRC0c5_QVRpySMabvyFEpR4BhuURGIAtext9eAmKz3swuHxW3OAAjdxVfKxtvJHEj2OeHfOx4YlE Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 74318a6f074f4d7ea084461473ef1a80 Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-TestMinimumBasicScenario-1566828925 Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:34.904052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74318a6f074f4d7ea084461473ef1a80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74318a6f074f4d7ea084461473ef1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74318a6f074f4d7ea084461473ef1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74318a6f074f4d7ea084461473ef1a80"}]}] Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-TestMinimumBasicScenario-1566828925 Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 74318a6f074f4d7ea084461473ef1a80 Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1566828925 Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-TestMinimumBasicScenario-1566828925-project Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 0815b4e3389240ada8d1c55941aca8cf Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-TestMinimumBasicScenario-1566828925-project Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance b061df6a-e663-49b1-baec-e555aa59534c could not be found. Sep 13 15:36:34.905576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': 'b061df6a-e663-49b1-baec-e555aa59534c'} Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b061df6a-e663-49b1-baec-e555aa59534c could not be found. Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:34.906468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b061df6a-e663-49b1-baec-e555aa59534c could not be found. Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b061df6a-e663-49b1-baec-e555aa59534c could not be found. Sep 13 15:36:34.908660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:34.910325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Returning 404 to user: Instance b061df6a-e663-49b1-baec-e555aa59534c could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:34.910325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8d5869e0-72c8-4b3f-9215-ef6c2f24a0b5 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c" status: 404 len: 111 microversion: 2.1 time: 0.033998 Sep 13 15:36:34.910325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 486/679] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:34 2022] GET /compute/v2.1/servers/b061df6a-e663-49b1-baec-e555aa59534c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:36:34.914217 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-701e0aff-d906-49c7-a7bc-42239fdaf699 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] Calling method '.version_select at 0x7f4bbf671820>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:34.937187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-701e0aff-d906-49c7-a7bc-42239fdaf699 tempest-TestMinimumBasicScenario-1566828925 tempest-TestMinimumBasicScenario-1566828925-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1608129216" status: 202 len: 0 microversion: 2.1 time: 0.026433 Sep 13 15:36:34.938242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 487/680] 10.222.0.16 () {58 vars in 1272 bytes} [Tue Sep 13 15:36:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1608129216 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:35.295900 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:35.296897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:35.305116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:35.305967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:35.307033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:35.308028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:35.308860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:35.309840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:35.351236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:35.352005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:35.352655 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:35.353346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lazy-loading 'fault' on Instance uuid 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:35.410948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:35.422125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e2a35007-d6b9-4f94-98b2-8094b4e8934d tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 200 len: 1326 microversion: 2.1 time: 0.130595 Sep 13 15:36:35.423542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 488/681] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:35 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:35.448402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:35.449247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:35.456914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:35.457832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:35.458387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:35.459163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:35.459686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:35.460315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:35.479583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 HTTP/1.1 Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:35.481300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:36:35.482868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '2ec25cef-3608-4af4-a0ff-119c601b2cb2'} Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:35.483813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:36:35.485244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:35.486638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:35.486638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-85776599-70b1-419e-be80-19942b4ca94b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 404 len: 111 microversion: 2.1 time: 0.039521 Sep 13 15:36:35.487477 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 489/682] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:35 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:36:35.492686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b9640e7b-33f5-463d-b703-262e59045125 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '.version_select at 0x7f4bbf6881f0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:35.519952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b9640e7b-33f5-463d-b703-262e59045125 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858115316" status: 202 len: 0 microversion: 2.1 time: 0.031468 Sep 13 15:36:35.520635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 490/683] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Sep 13 15:36:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858115316 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:36.349245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-53726199-4b67-4438-ba6e-0425284fbd80 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: .version_select at 0x7f4bbf76fe50>, body: {"keypair": {"name": "tempest-keypair-654696155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRnsuR/XeX+SDq4pr4IyvQT7jc16pBiuucAEKCgr9LDMb/RFeAE3xk5njrSGeaZJZuF+qMlobZkXjQZQdHnVcdz+DPKG5F9MHpIJr5bfb+9zCJNRCk4ccycycMNDETs/w=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:36.366079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-53726199-4b67-4438-ba6e-0425284fbd80 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:36:36.370129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-53726199-4b67-4438-ba6e-0425284fbd80 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:36:36.394569 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-53726199-4b67-4438-ba6e-0425284fbd80 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049843 Sep 13 15:36:36.395214 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 491/684] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:36:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:36.447890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:36.448606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:36.456439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:36.456942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:36.457762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:36.458480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:36.458942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:36.459371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:36.474249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] HTTP exception thrown: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Request method failure captured: Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae HTTP/1.1 Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKH5_I4ESPV3QyR1qaywLY2z-bpxdrHfRhQH_ZQvE6iUkGbwuBd1SQBXLBatRUFQrnfDELM7MxSRp63__Hsfq2Wdb9tFef15S6d5NYavEJrowXg44Au_DjF6TWB1MIgCliO1vBC-no6JBHJL7SPa25uCkSGIRBo_HAD2FjYjxJGixH8 Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:36.475965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}] Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c02aec8271af4bf7aea728ff92fa555b Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:36:36.477298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '05da62b3-a8ec-4148-b17b-2c08f0e0d2ae'} Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:36.478038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:36:36.479304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:36.480366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Returning 404 to user: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:36.480366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5edd7eec-3b39-4844-b1df-64bca71a8bc5 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 404 len: 111 microversion: 2.1 time: 0.033978 Sep 13 15:36:36.480366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 492/685] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:36 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:36:36.486224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-59bfe126-71e8-4c73-a36a-52f9eece5dd6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '.version_select at 0x7f4bbf3eec10>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:36.509018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-59bfe126-71e8-4c73-a36a-52f9eece5dd6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751649093" status: 202 len: 0 microversion: 2.1 time: 0.026445 Sep 13 15:36:36.509605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 493/686] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Sep 13 15:36:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751649093 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:36:37.467294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-47a5130c-b9cd-4bb3-ab1c-1c47b98022eb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'create', calling method: .version_select at 0x7f4bbf671b80>, body: {"keypair": {"name": "tempest-keypair-1746554532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGXMGAobl5FyXxNFb1jt2jdBBPty5gARuJk3/wiqj4s07WvE5OC3qHoh0iM4yIA2MtxA4tkRJEuFOmDX8S+P+R8tPGOPXUIP2ohHXJFwv5ga+8p8NQcZE880YrjOrwBWQ=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:37.500392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-47a5130c-b9cd-4bb3-ab1c-1c47b98022eb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for project 597b9e023e324874ac5f24ee571d1f66. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:36:37.506077 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-47a5130c-b9cd-4bb3-ab1c-1c47b98022eb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for user c02aec8271af4bf7aea728ff92fa555b and project 597b9e023e324874ac5f24ee571d1f66. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:36:37.540246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-47a5130c-b9cd-4bb3-ab1c-1c47b98022eb tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080898 Sep 13 15:36:37.541731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 494/687] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:36:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:38.552161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1137308070", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dae42ed5-9203-4331-a516-9ad32fc49ad2"}], "security_groups": [{"name": "tempest-securitygroup--1249155009"}], "key_name": "tempest-keypair-654696155", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:38.754310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] validate_networks() for [('dae42ed5-9203-4331-a516-9ad32fc49ad2', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:36:39.296443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:36:39.296865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:36:39.297538 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:36:39.297952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:36:39.298390 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:36:39.309659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:39.310248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:39.310757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:39.311905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:39.312451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:39.312929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:39.335034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:36:39.339252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:36:39.352409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:36:39.355934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:36:39.416786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-aaa3c408-4eee-4657-9579-8d17b0172f10 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.872516 Sep 13 15:36:39.425378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 495/688] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:36:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:36:39.437108 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1d21b236-de44-40db-b82d-42179985fb67 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:39.438015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1d21b236-de44-40db-b82d-42179985fb67 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:39.522910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1d21b236-de44-40db-b82d-42179985fb67 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:39.530856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1d21b236-de44-40db-b82d-42179985fb67 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1241 microversion: 2.1 time: 0.102547 Sep 13 15:36:39.547504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 496/689] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:39 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:40.002359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-900796562", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65fb418c-15cf-4bb3-9028-4f3e8b987c36"}], "security_groups": [{"name": "tempest-securitygroup--170864958"}], "key_name": "tempest-keypair-1746554532", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:40.152634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] validate_networks() for [('65fb418c-15cf-4bb3-9028-4f3e8b987c36', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:36:40.801625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:36:40.802146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:36:40.802772 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:36:40.803247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:36:40.803728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:36:40.819710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:40.820873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:40.822600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:40.823968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:40.824644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:40.825157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:40.857693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for project 597b9e023e324874ac5f24ee571d1f66. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:36:40.862558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Getting quotas for user c02aec8271af4bf7aea728ff92fa555b and project 597b9e023e324874ac5f24ee571d1f66. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:36:40.873885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:36:40.876109 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:36:40.938347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ff27d95a-049f-412f-a447-1711b71c36db tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.941231 Sep 13 15:36:40.939029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 497/690] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:36:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:36:40.943759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:40.944244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:40.950642 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:40.951351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:40.951966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:40.952823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:40.953431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:40.954022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:41.051313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lazy-loading 'services' on Instance uuid 0782cb8b-a07b-4d5c-8014-23397c7d38c1 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:41.198774 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b85fde71-0a76-4da2-92c5-e742febdbfac tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments/f27dfa1d-8c9d-4efa-886d-8ace98e875fc" status: 202 len: 0 microversion: 2.1 time: 0.256060 Sep 13 15:36:41.208965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 498/691] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:36:40 2022] DELETE /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments/f27dfa1d-8c9d-4efa-886d-8ace98e875fc => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:41.220349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:41.221387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:41.230300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:41.231249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:41.231865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:41.233142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:41.233809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:41.234815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:41.834517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:41.857819 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-66167abe-590b-45da-933f-1b167c507cc7 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.647068 Sep 13 15:36:41.858731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 499/692] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:41 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:41.886512 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:41.887519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:41.895439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:41.895942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:41.896382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:41.897103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:41.897561 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:41.897988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:42.005506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:42.016070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-847f25cb-8b51-4d44-9a7d-d715ce00b390 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1233 microversion: 2.1 time: 0.144241 Sep 13 15:36:42.017954 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 500/693] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:41 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1233 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:42.028202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:42.031410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:42.048607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:42.049426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:42.050381 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:42.051465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:42.052924 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:42.054062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:42.102871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ef52f433-1e18-4fd8-901b-1ddb0cef5df1 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082727 Sep 13 15:36:42.104297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 501/694] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:42 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:42.668119 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-a9b8cc29-ba0a-446e-a0ea-9c8e99e307fa req-291643c1-d6e0-4636-b1a7-56aa115d776b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d53a86-9ab1-43c5-a755-d1ccb689be99", "tag": "a8e08ac3-21a0-4069-81e3-37a7f32cff29"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:42.683850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=8 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:42.718144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a9b8cc29-ba0a-446e-a0ea-9c8e99e307fa req-291643c1-d6e0-4636-b1a7-56aa115d776b service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:42.718823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a9b8cc29-ba0a-446e-a0ea-9c8e99e307fa req-291643c1-d6e0-4636-b1a7-56aa115d776b service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:42.719309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a9b8cc29-ba0a-446e-a0ea-9c8e99e307fa req-291643c1-d6e0-4636-b1a7-56aa115d776b service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:42.745344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-a9b8cc29-ba0a-446e-a0ea-9c8e99e307fa req-291643c1-d6e0-4636-b1a7-56aa115d776b service nova] Creating event network-changed:a8e08ac3-21a0-4069-81e3-37a7f32cff29 for instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 on hv-cinder-85743 Sep 13 15:36:42.759600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-a9b8cc29-ba0a-446e-a0ea-9c8e99e307fa req-291643c1-d6e0-4636-b1a7-56aa115d776b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100062 Sep 13 15:36:42.760943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 502/695] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:42.894950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:42.899095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:42.919025 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:42.919915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:42.921866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:42.923713 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:42.928838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:42.929781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.259023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:43.267064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-949fdf8c-1e2d-45c6-9bc5-0402998ea1c4 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.385201 Sep 13 15:36:43.267639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 503/696] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:42 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:43.272169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:43.272789 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:43.279126 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.279616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.280052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.280760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.281199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.281803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.382763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:43.395682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0cb372ef-277b-49f9-9bb1-db2de3075a03 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1295 microversion: 2.1 time: 0.126936 Sep 13 15:36:43.401316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 504/697] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:43 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:43.414925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:43.417234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:43.424300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.424882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.425383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.426189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.426712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.427199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.461664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ba7b01aa-63c8-44a0-bbd0-fd41954e5109 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058873 Sep 13 15:36:43.462743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 505/698] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:36:43 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:36:43.553609 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:43.554220 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:43.560337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.561064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.561526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.562510 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.563030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.563502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.592066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:43.681396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c614fa59-5f16-42e0-9cba-e632097b1650 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 204 len: 0 microversion: 2.1 time: 0.131603 Sep 13 15:36:43.682595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 506/699] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:36:43 2022] DELETE /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:36:43.691281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:43.692355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:43.699013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.699722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.700315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.701184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:43.701641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:43.702247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:43.904054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:43.914048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-37dc2d80-eedb-48db-8ab7-620993a2dfce tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1688 microversion: 2.1 time: 0.227004 Sep 13 15:36:43.914706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 507/700] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:43 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:44.296035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:44.297553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:44.320238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:44.320745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:44.321178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:44.323686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:44.324780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:44.325378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:44.485717 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:44.495248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8c70ec7c-2ba5-4c5b-bbc1-2c2f6046b359 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.206269 Sep 13 15:36:44.495922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 508/701] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:44 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:44.500703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:44.501586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:44.515267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:44.515807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:44.517261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:44.518020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:44.519121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:44.519419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:44.662303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:44.670470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dfcb8749-3acf-4499-ac5b-e9665d6c4d81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.173293 Sep 13 15:36:44.671303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 509/702] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:44 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:44.938128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:44.938990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:44.945070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:44.945551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:44.945980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:44.946694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:44.947137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:44.947549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:44.951670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:45.086799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:45.095813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-55550418-795a-4c0f-a3f3-94760ed24ce3 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1688 microversion: 2.1 time: 0.161646 Sep 13 15:36:45.096347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 510/703] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:44 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:45.521252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:45.521975 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:45.532673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:45.533956 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:45.534607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:45.535688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:45.536290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:45.536882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:45.799401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:45.808999 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c0b57811-7b82-45a5-b38d-21e271d4b87f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.293514 Sep 13 15:36:45.809933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 511/704] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:45 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:45.815581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:45.816457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:45.823861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:45.824855 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:45.825491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:45.826336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:45.826888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:45.827376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:46.062794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:46.071018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3a192f70-83db-4760-b76f-8aec78367fe4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.259681 Sep 13 15:36:46.071852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 512/705] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:45 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:46.119142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:46.119992 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:46.126280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:46.127626 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:46.128425 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:46.129296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:46.129920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:46.130765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:46.332832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:46.340746 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-51c40085-326c-4b48-aa5f-2722e6da42dd tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1688 microversion: 2.1 time: 0.225551 Sep 13 15:36:46.341330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 513/706] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:46 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:46.345804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-7b73cb2b-ba55-42a8-93dc-552a81f86bbd req-1717fa77-5aa1-4a48-977a-2fe442f659d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee29b76-b8d1-4887-b427-fdb42f9a7bb2", "tag": "06e93362-26cb-407c-9bce-1c6ee8605997"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:46.355675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7b73cb2b-ba55-42a8-93dc-552a81f86bbd req-1717fa77-5aa1-4a48-977a-2fe442f659d9 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:46.355839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7b73cb2b-ba55-42a8-93dc-552a81f86bbd req-1717fa77-5aa1-4a48-977a-2fe442f659d9 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:46.356160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-7b73cb2b-ba55-42a8-93dc-552a81f86bbd req-1717fa77-5aa1-4a48-977a-2fe442f659d9 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:46.369447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-7b73cb2b-ba55-42a8-93dc-552a81f86bbd req-1717fa77-5aa1-4a48-977a-2fe442f659d9 service nova] Creating event network-changed:06e93362-26cb-407c-9bce-1c6ee8605997 for instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 on hv-cinder-85743 Sep 13 15:36:46.374338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-7b73cb2b-ba55-42a8-93dc-552a81f86bbd req-1717fa77-5aa1-4a48-977a-2fe442f659d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031849 Sep 13 15:36:46.374955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 514/707] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:46.843095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:46.844235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:46.854764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:46.855552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:46.856266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:46.857390 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:46.858232 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:46.858918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:47.013836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:47.022586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f25426a0-033e-4fa9-8b49-2c3142920e6f tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.187322 Sep 13 15:36:47.023159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 515/708] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:46 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:47.094221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:47.095074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:47.101212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:47.101696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:47.102138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:47.102836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:47.103286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:47.103706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:47.243734 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:47.252085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a06b4d54-bcb5-4109-8994-4d0ae734f41f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.161624 Sep 13 15:36:47.252681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 516/709] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:47 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:47.366392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:47.367187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:47.375397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:47.376059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:47.376593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:47.377284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:47.377733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:47.378133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:47.517880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:47.526132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e5594cf0-76d1-4bbe-b497-c16ea8191187 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1688 microversion: 2.1 time: 0.164848 Sep 13 15:36:47.526721 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 517/710] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:47 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:48.047473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:48.048125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:48.055462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:48.055959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:48.056406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:48.057102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:48.057558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:48.057959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:48.190955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:48.198980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1c00ea23-3191-4d37-a247-c7907b3725ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.157462 Sep 13 15:36:48.199541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 518/711] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:48 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:48.217864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-ade28a7f-fdef-4db2-9431-6b65ba0cdc2f req-232cc6f1-0e3e-4ebc-93d9-ff9fa54d4c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d53a86-9ab1-43c5-a755-d1ccb689be99", "name": "network-vif-plugged", "status": "completed", "tag": "a8e08ac3-21a0-4069-81e3-37a7f32cff29"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:48.228753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ade28a7f-fdef-4db2-9431-6b65ba0cdc2f req-232cc6f1-0e3e-4ebc-93d9-ff9fa54d4c04 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:48.229299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ade28a7f-fdef-4db2-9431-6b65ba0cdc2f req-232cc6f1-0e3e-4ebc-93d9-ff9fa54d4c04 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:48.229850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ade28a7f-fdef-4db2-9431-6b65ba0cdc2f req-232cc6f1-0e3e-4ebc-93d9-ff9fa54d4c04 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:48.241154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-ade28a7f-fdef-4db2-9431-6b65ba0cdc2f req-232cc6f1-0e3e-4ebc-93d9-ff9fa54d4c04 service nova] Creating event network-vif-plugged:a8e08ac3-21a0-4069-81e3-37a7f32cff29 for instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 on hv-cinder-85743 Sep 13 15:36:48.246368 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-ade28a7f-fdef-4db2-9431-6b65ba0cdc2f req-232cc6f1-0e3e-4ebc-93d9-ff9fa54d4c04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032386 Sep 13 15:36:48.246991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 519/712] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:48.275697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:48.276548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:48.286530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:48.286994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:48.287378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:48.288204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:48.288859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:48.289432 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:48.474298 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:48.482156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-86878d51-d904-4c8a-b829-cc638207a039 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.210712 Sep 13 15:36:48.482682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 520/713] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:48 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:48.552247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:48.552971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:48.562806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:48.563931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:48.564349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:48.565065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:48.565500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:48.565919 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:48.740605 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:48.748467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-506237ba-f784-45fa-875f-b57fe7984647 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1688 microversion: 2.1 time: 0.202597 Sep 13 15:36:48.749037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 521/714] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:48 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:49.222835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:49.223547 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:49.230289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:49.230777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:49.231212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:49.231944 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:49.232407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:49.232834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:49.466928 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:49.475921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d79f8316-1448-483d-8058-9c1484ad8c13 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.257116 Sep 13 15:36:49.476587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 522/715] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:49 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:49.505105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:49.505875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:49.513283 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:49.513775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:49.514253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:49.515124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:49.515582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:49.515990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:49.997112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:50.008061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-344a4102-65d6-4dcf-b28e-4e740be2bc9f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.506328 Sep 13 15:36:50.009931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 523/716] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:49 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:50.030016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:50.032639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:50.039335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:50.040064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:50.040671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:50.041599 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:50.042288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:50.042898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:50.078517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:50.079158 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:50.079666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:50.080556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lazy-loading 'fault' on Instance uuid 0782cb8b-a07b-4d5c-8014-23397c7d38c1 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:50.171719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:50.179689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3110d996-b55d-4995-b73f-aef04b6c63ae tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1335 microversion: 2.1 time: 0.159628 Sep 13 15:36:50.193552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 524/717] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:50 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1335 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:50.198457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-a626dc8b-03c4-4760-9a1d-3f6f82409e46 req-74d278c3-a7a5-4a82-a2d9-39c91d08343f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0782cb8b-a07b-4d5c-8014-23397c7d38c1", "name": "network-vif-deleted", "tag": "a5830845-c6ca-471c-ae1c-f8508ae26cc3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:50.208840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a626dc8b-03c4-4760-9a1d-3f6f82409e46 req-74d278c3-a7a5-4a82-a2d9-39c91d08343f service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:50.209324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a626dc8b-03c4-4760-9a1d-3f6f82409e46 req-74d278c3-a7a5-4a82-a2d9-39c91d08343f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:50.209755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a626dc8b-03c4-4760-9a1d-3f6f82409e46 req-74d278c3-a7a5-4a82-a2d9-39c91d08343f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:50.221834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-a626dc8b-03c4-4760-9a1d-3f6f82409e46 req-74d278c3-a7a5-4a82-a2d9-39c91d08343f service nova] Creating event network-vif-deleted:a5830845-c6ca-471c-ae1c-f8508ae26cc3 for instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 on hv-cinder-85743 Sep 13 15:36:50.226493 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-a626dc8b-03c4-4760-9a1d-3f6f82409e46 req-74d278c3-a7a5-4a82-a2d9-39c91d08343f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031708 Sep 13 15:36:50.227107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 525/718] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:50.500880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:50.501860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:50.510773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:50.511302 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:50.511737 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:50.512521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:50.513011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:50.513469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:50.664041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:50.673441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2e019b87-9041-4614-87f0-89353090859b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1367 microversion: 2.1 time: 0.177370 Sep 13 15:36:50.674175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 526/719] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:50 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:51.037683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:51.038245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:51.040192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:51.040874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=22 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:51.048651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.049155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.049596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.050343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.050802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.051228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.193447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:51.201480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b9dcf414-c46e-4a1d-9a74-2e4419d1c215 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.168124 Sep 13 15:36:51.202020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 527/720] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:51 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:51.207018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:51.207614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:51.213421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.213905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.214366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.215052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.215501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.215914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.236273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:51.251648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.252137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.252566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.253016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lazy-loading 'fault' on Instance uuid 0782cb8b-a07b-4d5c-8014-23397c7d38c1 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:51.305161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:51.316829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-01c6fbbf-3944-4b9b-afb8-f7278058fd88 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1335 microversion: 2.1 time: 0.113411 Sep 13 15:36:51.317594 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 528/721] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:51 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1335 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:51.699392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:51.700007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:51.707555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.708045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.708490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.709183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.709644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.710055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.845441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:51.853554 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-400bc197-d598-4432-a24b-d769777f792c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1558 microversion: 2.1 time: 0.158132 Sep 13 15:36:51.854128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 529/722] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:51 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:51.876239 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:51.876615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:51.882554 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.883045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.883482 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.884153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:51.884610 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:51.885036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:51.963323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4c0c00f3-5ea2-4386-acdc-d19e382d486e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090944 Sep 13 15:36:51.964121 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 530/723] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:36:51 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:52.225050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:52.225860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:52.232385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:52.232873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:52.233301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:52.233991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:52.234476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:52.234894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:52.367851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:52.376207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cfcc1c54-958c-4145-9755-d54f3a8a4128 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.155113 Sep 13 15:36:52.376788 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 531/724] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:52 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:52.381361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:52.382189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:52.388269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:52.388756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:52.389185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:52.389889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:52.390364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:52.390786 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:52.425989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:52.426494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:52.426925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:52.427390 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lazy-loading 'fault' on Instance uuid 0782cb8b-a07b-4d5c-8014-23397c7d38c1 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:36:52.474480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:52.482828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2618c12b-9f94-4521-b696-24d4c0a45f21 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 200 len: 1335 microversion: 2.1 time: 0.104946 Sep 13 15:36:52.483421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 532/725] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:52 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:52.946285 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:36:52.946806 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:36:53.232183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-d0cd512d-0741-45ac-a944-4111c074ad07 req-e44e9541-c408-4f21-8a40-b260a261512a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d53a86-9ab1-43c5-a755-d1ccb689be99", "tag": "a8e08ac3-21a0-4069-81e3-37a7f32cff29"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:53.242556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d0cd512d-0741-45ac-a944-4111c074ad07 req-e44e9541-c408-4f21-8a40-b260a261512a service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:53.243031 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d0cd512d-0741-45ac-a944-4111c074ad07 req-e44e9541-c408-4f21-8a40-b260a261512a service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:53.243448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d0cd512d-0741-45ac-a944-4111c074ad07 req-e44e9541-c408-4f21-8a40-b260a261512a service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:53.254889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-d0cd512d-0741-45ac-a944-4111c074ad07 req-e44e9541-c408-4f21-8a40-b260a261512a service nova] Creating event network-changed:a8e08ac3-21a0-4069-81e3-37a7f32cff29 for instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 on hv-cinder-85743 Sep 13 15:36:53.259887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-d0cd512d-0741-45ac-a944-4111c074ad07 req-e44e9541-c408-4f21-8a40-b260a261512a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031388 Sep 13 15:36:53.260542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 533/726] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:36:53.400347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:53.401492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:53.408584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:53.409405 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:53.409920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:53.410918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:53.411447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:53.412030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:53.617902 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:53.628732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-08510e4d-a938-41ac-82b7-6dd4687e932b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.232213 Sep 13 15:36:53.629882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 534/727] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:53 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:53.634980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:53.635760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 0782cb8b-a07b-4d5c-8014-23397c7d38c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:53.651550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:53.651550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:53.651855 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:53.652568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:53.653023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:53.653447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:53.667408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] HTTP exception thrown: Instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 could not be found. Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Request method failure captured: Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 HTTP/1.1 Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDu5gSlDj_2xS0l19tkew5jUPNXHSUDlZxnth8rcpscPiH0UQO2fdUlp9i-NCt2Jpx5NpR7etGwnPFFRH9fXozIirkXcNGhupSa4F53gx3DHtg5G5hpt0kPSKruQrtlKLVXKZeDyf7kEG9EcXzEWmRQoXDmea0r89AYjOoEaey2vs Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:53.669085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}] Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 97189d5c87c94be2bef7cff79c471c7d Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 could not be found. Sep 13 15:36:53.670829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '0782cb8b-a07b-4d5c-8014-23397c7d38c1'} Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 could not be found. Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:53.675351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 could not be found. Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 could not be found. Sep 13 15:36:53.676741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:53.677986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Returning 404 to user: Instance 0782cb8b-a07b-4d5c-8014-23397c7d38c1 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:53.677986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-308c3ae4-4d57-48ea-b3d0-985115f38527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1" status: 404 len: 111 microversion: 2.1 time: 0.039242 Sep 13 15:36:53.677986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 535/728] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:53 2022] GET /compute/v2.1/servers/0782cb8b-a07b-4d5c-8014-23397c7d38c1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:36:53.683268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-16acf727-c590-45ca-ba3e-7c894237fc3d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '.version_select at 0x7f4bbf66b0d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:53.706062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-16acf727-c590-45ca-ba3e-7c894237fc3d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749516263" status: 202 len: 0 microversion: 2.1 time: 0.027189 Sep 13 15:36:53.710272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 536/729] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Sep 13 15:36:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749516263 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:36:54.655581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:54.656258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:54.663608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:54.664086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:54.664517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:54.665208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:54.665661 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:54.666080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:54.817861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:54.826039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-787d0e88-da71-4c88-ad60-8064ed36d74a tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.177399 Sep 13 15:36:54.826644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 537/730] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:54 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:55.849499 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:55.850120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:55.857187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:55.857673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:55.858118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:55.858853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:55.859311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:55.859739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:56.007693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:56.020182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5b7848b1-4e16-404d-8c4d-cd8fb4f31f00 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.174359 Sep 13 15:36:56.020896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 538/731] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:55 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:56.266392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-c42f8213-75fb-441e-a47d-f63630ae3f41 req-1b3de451-30d3-466b-a43c-fb448a356d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee29b76-b8d1-4887-b427-fdb42f9a7bb2", "name": "network-vif-plugged", "status": "completed", "tag": "06e93362-26cb-407c-9bce-1c6ee8605997"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:56.276329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c42f8213-75fb-441e-a47d-f63630ae3f41 req-1b3de451-30d3-466b-a43c-fb448a356d5a service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:56.276806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c42f8213-75fb-441e-a47d-f63630ae3f41 req-1b3de451-30d3-466b-a43c-fb448a356d5a service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:56.277276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c42f8213-75fb-441e-a47d-f63630ae3f41 req-1b3de451-30d3-466b-a43c-fb448a356d5a service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:56.289687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-c42f8213-75fb-441e-a47d-f63630ae3f41 req-1b3de451-30d3-466b-a43c-fb448a356d5a service nova] Creating event network-vif-plugged:06e93362-26cb-407c-9bce-1c6ee8605997 for instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 on hv-cinder-85743 Sep 13 15:36:56.294728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-c42f8213-75fb-441e-a47d-f63630ae3f41 req-1b3de451-30d3-466b-a43c-fb448a356d5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032200 Sep 13 15:36:56.295403 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 539/732] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:56.663727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:56.664309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:56.670947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:56.671436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:56.671869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:56.672604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:56.673268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:56.673700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:56.701616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:56.787416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c17424b6-ed7a-48a7-86b5-5d04271b9d2a tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 204 len: 0 microversion: 2.1 time: 0.127541 Sep 13 15:36:56.787926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 540/733] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:36:56 2022] DELETE /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:36:56.796108 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:56.796811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:56.803182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:56.803649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:56.804142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:56.804862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:56.805300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:56.805719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:56.947753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:56.960155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a2e7f88-9b03-4e1b-a4a1-f04afaac26f2 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1507 microversion: 2.1 time: 0.167660 Sep 13 15:36:56.961010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 541/734] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:56 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:57.051130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:57.051994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:57.056544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:57.063237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:57.063728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:57.064154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:57.064848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:57.065295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:57.065742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:57.198621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:57.206967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1da23568-7469-49df-b85f-277f3cde1f8c tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.162186 Sep 13 15:36:57.207534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 542/735] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:57 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:57.986683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:57.987363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:57.994210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:57.994744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:57.995181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:57.995865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:57.996383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:57.996808 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:58.212224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:58.221673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3cf85acb-62d9-47e4-877b-a0e52a60db5e tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 200 len: 1507 microversion: 2.1 time: 0.239115 Sep 13 15:36:58.222592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 543/736] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:57 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:58.238362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:58.238964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:58.244883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:58.245369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:58.245812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:58.246534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:58.246984 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:58.247399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:58.458759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:58.470364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e16eb7e2-9024-46b1-8922-ba063af61bbd tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1362 microversion: 2.1 time: 0.235928 Sep 13 15:36:58.470964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 544/737] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:58 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:58.491518 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-883e74ca-582f-401c-808c-7069ea6dc62a req-0bea7e8a-1d21-421f-a1c8-ab644e73f5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ef7238-7280-4c0f-b213-4efdc33bccc0", "name": "network-vif-deleted", "tag": "791fe666-c2cb-4d8a-91fa-3927d141b45c"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:36:58.504477 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-883e74ca-582f-401c-808c-7069ea6dc62a req-0bea7e8a-1d21-421f-a1c8-ab644e73f5de service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:58.505038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-883e74ca-582f-401c-808c-7069ea6dc62a req-0bea7e8a-1d21-421f-a1c8-ab644e73f5de service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:58.505482 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-883e74ca-582f-401c-808c-7069ea6dc62a req-0bea7e8a-1d21-421f-a1c8-ab644e73f5de service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:58.516806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-883e74ca-582f-401c-808c-7069ea6dc62a req-0bea7e8a-1d21-421f-a1c8-ab644e73f5de service nova] Creating event network-vif-deleted:791fe666-c2cb-4d8a-91fa-3927d141b45c for instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 on hv-cinder-85743 Sep 13 15:36:58.522054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-883e74ca-582f-401c-808c-7069ea6dc62a req-0bea7e8a-1d21-421f-a1c8-ab644e73f5de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042603 Sep 13 15:36:58.522946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 545/738] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:36:59.250520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:59.251520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: 29ef7238-7280-4c0f-b213-4efdc33bccc0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:59.258262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.258749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.259178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.259864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.260310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.260733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.274849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] HTTP exception thrown: Instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 could not be found. Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Request method failure captured: Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 HTTP/1.1 Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDu5gSlDj_2xS0l19tkew5jUPNXHSUDlZxnth8rcpscPiH0UQO2fdUlp9i-NCt2Jpx5NpR7etGwnPFFRH9fXozIirkXcNGhupSa4F53gx3DHtg5G5hpt0kPSKruQrtlKLVXKZeDyf7kEG9EcXzEWmRQoXDmea0r89AYjOoEaey2vs Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:36:59.276439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}] Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 97189d5c87c94be2bef7cff79c471c7d Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 could not be found. Sep 13 15:36:59.277864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '29ef7238-7280-4c0f-b213-4efdc33bccc0'} Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 could not be found. Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:36:59.278649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 could not be found. Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 could not be found. Sep 13 15:36:59.280075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:36:59.281640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Returning 404 to user: Instance 29ef7238-7280-4c0f-b213-4efdc33bccc0 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:36:59.281640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2b9d1e44-5995-4ef7-b902-d5e92ea79b91 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0" status: 404 len: 111 microversion: 2.1 time: 0.035077 Sep 13 15:36:59.281640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 546/739] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:59 2022] GET /compute/v2.1/servers/29ef7238-7280-4c0f-b213-4efdc33bccc0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:36:59.286700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:59.287189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:59.292973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.293445 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.293868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.294572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.295004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.295419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.316757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:36:59.325142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:36:59.408104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-424e72f0-b941-4d67-bd38-437651cbfc2d tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 204 len: 0 microversion: 2.1 time: 0.124997 Sep 13 15:36:59.408646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 547/740] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:36:59 2022] DELETE /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:36:59.418697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:59.419649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:59.427116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.427606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.428030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.428733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.429178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.429588 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.572445 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:59.580486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f7ba495c-5363-4fbf-984f-6abb2e010527 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.167346 Sep 13 15:36:59.581373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 548/741] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:59 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:36:59.586028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:59.586679 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:59.592842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.593413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.593920 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.594742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.595715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.596236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.730982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:36:59.743201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-015ab92a-a4b7-41e9-8ea4-e639d6ede0bf tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1547 microversion: 2.1 time: 0.160491 Sep 13 15:36:59.744044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 549/742] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:36:59 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:36:59.768291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:36:59.768702 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:36:59.775189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.775676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.776108 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.776799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:36:59.777251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:36:59.777676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:36:59.856794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2f94eff4-3e05-4c25-af31-58ac519c0382 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092251 Sep 13 15:36:59.857411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 550/743] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:36:59 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:37:00.604620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:00.605295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:00.612085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:00.612572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:00.613008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:00.613922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:00.614419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:00.614845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:00.811261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:00.820080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2bacfac7-36e4-4c8a-b1f5-5ecaedf4d518 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.220162 Sep 13 15:37:00.821040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 551/744] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:37:00 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:37:00.916180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-68e17089-1014-4b51-aac6-6900d9851db9 req-f78063fa-9d52-491e-b9e5-c4f78a0afa28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee29b76-b8d1-4887-b427-fdb42f9a7bb2", "tag": "06e93362-26cb-407c-9bce-1c6ee8605997"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:37:00.926292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-68e17089-1014-4b51-aac6-6900d9851db9 req-f78063fa-9d52-491e-b9e5-c4f78a0afa28 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:00.926851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-68e17089-1014-4b51-aac6-6900d9851db9 req-f78063fa-9d52-491e-b9e5-c4f78a0afa28 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:00.927349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-68e17089-1014-4b51-aac6-6900d9851db9 req-f78063fa-9d52-491e-b9e5-c4f78a0afa28 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:00.939200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-68e17089-1014-4b51-aac6-6900d9851db9 req-f78063fa-9d52-491e-b9e5-c4f78a0afa28 service nova] Creating event network-changed:06e93362-26cb-407c-9bce-1c6ee8605997 for instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 on hv-cinder-85743 Sep 13 15:37:00.944511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-68e17089-1014-4b51-aac6-6900d9851db9 req-f78063fa-9d52-491e-b9e5-c4f78a0afa28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031959 Sep 13 15:37:00.945556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 552/745] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:37:01.846685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:01.847373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:01.855509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:01.856098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:01.856600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:01.857423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:01.857956 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:01.858460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:02.021310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97189d5c87c94be2bef7cff79c471c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f8e7ebb2814be392842c2e17d55fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:02.029827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-66687534-e859-46d3-b1f1-66872ff62928 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 200 len: 1522 microversion: 2.1 time: 0.189177 Sep 13 15:37:02.030896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 553/746] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:37:01 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:37:02.429187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-796b3fc2-75d3-45b3-ad57-c467bf83adf3 req-b45e20ef-b810-4d60-a4f1-e31994a6afde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecad0016-167e-481d-bc1a-44f01c614a59", "name": "network-vif-deleted", "tag": "678a26e2-4972-4820-8b36-e8ab2402f95d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:37:02.441963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-796b3fc2-75d3-45b3-ad57-c467bf83adf3 req-b45e20ef-b810-4d60-a4f1-e31994a6afde service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:02.442468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-796b3fc2-75d3-45b3-ad57-c467bf83adf3 req-b45e20ef-b810-4d60-a4f1-e31994a6afde service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:02.442893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-796b3fc2-75d3-45b3-ad57-c467bf83adf3 req-b45e20ef-b810-4d60-a4f1-e31994a6afde service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:02.458150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-796b3fc2-75d3-45b3-ad57-c467bf83adf3 req-b45e20ef-b810-4d60-a4f1-e31994a6afde service nova] Creating event network-vif-deleted:678a26e2-4972-4820-8b36-e8ab2402f95d for instance ecad0016-167e-481d-bc1a-44f01c614a59 on hv-cinder-85743 Sep 13 15:37:02.463767 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-796b3fc2-75d3-45b3-ad57-c467bf83adf3 req-b45e20ef-b810-4d60-a4f1-e31994a6afde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038345 Sep 13 15:37:02.464362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 554/747] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:37:03.055094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:03.055817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] [instance: ecad0016-167e-481d-bc1a-44f01c614a59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:03.062475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:03.063046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:03.063479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:03.064614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:03.065104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:03.065646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:03.081744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] HTTP exception thrown: Instance ecad0016-167e-481d-bc1a-44f01c614a59 could not be found. Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Request method failure captured: Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 HTTP/1.1 Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDu5gSlDj_2xS0l19tkew5jUPNXHSUDlZxnth8rcpscPiH0UQO2fdUlp9i-NCt2Jpx5NpR7etGwnPFFRH9fXozIirkXcNGhupSa4F53gx3DHtg5G5hpt0kPSKruQrtlKLVXKZeDyf7kEG9EcXzEWmRQoXDmea0r89AYjOoEaey2vs Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:37:03.083460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07f8e7ebb2814be392842c2e17d55fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07f8e7ebb2814be392842c2e17d55fca"}]}] Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 07f8e7ebb2814be392842c2e17d55fca Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1462768076 Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 97189d5c87c94be2bef7cff79c471c7d Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1462768076-project Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance ecad0016-167e-481d-bc1a-44f01c614a59 could not be found. Sep 13 15:37:03.084990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': 'ecad0016-167e-481d-bc1a-44f01c614a59'} Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecad0016-167e-481d-bc1a-44f01c614a59 could not be found. Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:37:03.085950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecad0016-167e-481d-bc1a-44f01c614a59 could not be found. Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecad0016-167e-481d-bc1a-44f01c614a59 could not be found. Sep 13 15:37:03.087447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:03.088941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] Returning 404 to user: Instance ecad0016-167e-481d-bc1a-44f01c614a59 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:37:03.088941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9ed171f1-daa7-42a1-95c5-f0f534d99cc4 tempest-ServerRescueNegativeTestJSON-1462768076 tempest-ServerRescueNegativeTestJSON-1462768076-project] 10.222.0.16 "GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59" status: 404 len: 111 microversion: 2.1 time: 0.035351 Sep 13 15:37:03.088941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 555/748] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:37:03 2022] GET /compute/v2.1/servers/ecad0016-167e-481d-bc1a-44f01c614a59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:37:07.727086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6b7b5e07-3200-481f-84b4-506bb57b3f39 tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Action: 'create', calling method: .version_select at 0x7f4bbf6689d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-682875226", "metadata": {"Type": "work"}}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:37:08.049749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6b7b5e07-3200-481f-84b4-506bb57b3f39 tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.442555 Sep 13 15:37:08.051264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 556/749] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Sep 13 15:37:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 445 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 15:37:08.065025 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b3a8b482-7d46-4566-babe-6886f3d5f0f6 tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Calling method '.version_select at 0x7f4bbf6c68b0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:08.120842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b3a8b482-7d46-4566-babe-6886f3d5f0f6 tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2" status: 200 len: 352 microversion: 2.1 time: 0.059669 Sep 13 15:37:08.121425 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 557/750] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:37:08 2022] GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:37:09.136991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-88758b39-c6d1-4089-aae2-c397e4fcf88e tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Calling method '.version_select at 0x7f4bbf66b820>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:09.187388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-88758b39-c6d1-4089-aae2-c397e4fcf88e tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2" status: 200 len: 353 microversion: 2.1 time: 0.054910 Sep 13 15:37:09.188124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 558/751] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:37:09 2022] GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:37:09.200990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-46f2992a-cd17-426c-aee7-ec3313929235 tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Calling method '.version_select at 0x7f4bbf688160>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:09.247492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-46f2992a-cd17-426c-aee7-ec3313929235 tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2" status: 200 len: 353 microversion: 2.1 time: 0.050244 Sep 13 15:37:09.248052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 559/752] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:37:09 2022] GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:37:09.265441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d45aa54e-8338-4308-8208-723492616faa tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Calling method '.version_select at 0x7f4bbf76f670>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:09.341264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d45aa54e-8338-4308-8208-723492616faa tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2" status: 202 len: 0 microversion: 2.1 time: 0.079481 Sep 13 15:37:09.341824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 560/753] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:37:09 2022] DELETE /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:37:09.350226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-31c0a211-4243-45ba-8afe-90867f7a976d tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Calling method '.version_select at 0x7f4bbf668790>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:09.398558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-31c0a211-4243-45ba-8afe-90867f7a976d tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2" status: 200 len: 352 microversion: 2.1 time: 0.052511 Sep 13 15:37:09.399140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 561/754] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:37:09 2022] GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:37:10.413606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9bd5b7d8-fa29-4c1d-9410-521cc328452d tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Calling method '.version_select at 0x7f4bbf3b1430>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:10.445129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-9bd5b7d8-fa29-4c1d-9410-521cc328452d tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] HTTP exception thrown: Volume ecea2c13-c33c-4a78-a738-d61d481b6ed2 could not be found. Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9bd5b7d8-fa29-4c1d-9410-521cc328452d tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Request method failure captured: Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2 HTTP/1.1 Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKOjsH0QLbAQ2a4IkApk60IbGSXBBGxxphZWwJmK8GZwkq5TtCSbnsK4fMBrs-B9wntAJD1zPDciO4GHYvF1tzIbis8NdG9f9hbRyrhd8u28yq2DQiMWloJbV0JM9bWA_EcCgUEPZeJ-kaPSUuYzhCFUBu_2X_2elbLGY8w39WsZQIk Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 113d200ad37e45fd85c40d4a9dd9a1f0 Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesGetTestJSON-1365212869 Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:37:10.447248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/113d200ad37e45fd85c40d4a9dd9a1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_113d200ad37e45fd85c40d4a9dd9a1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/113d200ad37e45fd85c40d4a9dd9a1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/113d200ad37e45fd85c40d4a9dd9a1f0"}]}] Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesGetTestJSON-1365212869 Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 113d200ad37e45fd85c40d4a9dd9a1f0 Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesGetTestJSON-1365212869 Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesGetTestJSON-1365212869-project Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: e3b8f96f086f4e319ca1cf8b8857d581 Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesGetTestJSON-1365212869-project Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Volume ecea2c13-c33c-4a78-a738-d61d481b6ed2 could not be found. Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': 'ecea2c13-c33c-4a78-a738-d61d481b6ed2'} Sep 13 15:37:10.448987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ecea2c13-c33c-4a78-a738-d61d481b6ed2 could not be found. (HTTP 404) (Request-ID: req-e3e437db-a2f1-4926-a80c-060da1bdb765) Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:37:10.453340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:37:10.454761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ecea2c13-c33c-4a78-a738-d61d481b6ed2 could not be found. Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 15:37:10.456852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ecea2c13-c33c-4a78-a738-d61d481b6ed2 could not be found. Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ecea2c13-c33c-4a78-a738-d61d481b6ed2 could not be found. Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9bd5b7d8-fa29-4c1d-9410-521cc328452d tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] Returning 404 to user: Volume ecea2c13-c33c-4a78-a738-d61d481b6ed2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9bd5b7d8-fa29-4c1d-9410-521cc328452d tempest-VolumesGetTestJSON-1365212869 tempest-VolumesGetTestJSON-1365212869-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2" status: 404 len: 109 microversion: 2.1 time: 0.040107 Sep 13 15:37:10.458321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 562/755] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:37:10 2022] GET /compute/v2.1/os-volumes/ecea2c13-c33c-4a78-a738-d61d481b6ed2 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:37:35.319672 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:35.320413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:35.325398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:35.325972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:35.334629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:35.335181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:35.335611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:35.336330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:35.336790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:35.337215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:35.364227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-69ddab2f-2b16-46a9-8804-9c687e743040 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.046005 Sep 13 15:37:35.364810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 563/756] 10.222.0.16 () {60 vars in 1289 bytes} [Tue Sep 13 15:37:35 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:37:37.295731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:37:37.296444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:37.303020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:37.303502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:37.303931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:37.304614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:37.305062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:37.305477 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:37.332320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lazy-loading 'flavor' on Instance uuid 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:37:37.537734 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-078e0385-2f27-4191-bdc1-cd87a8a34df2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/action" status: 202 len: 0 microversion: 2.20 time: 0.245864 Sep 13 15:37:37.538363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 564/757] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 13 15:37:37 2022] POST /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:37:37.548955 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:37.550009 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:37.557110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:37.557597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:37.558046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:37.558779 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:37.559344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:37.559788 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:37.702453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:37.716566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:37.719022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:37.720958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1c3a0682-70bf-49e1-b377-97019e9d2e9a tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.177013 Sep 13 15:37:37.721887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 565/758] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:37 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:37:38.755974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:38.756693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:38.763607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:38.764098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:38.764512 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:38.765201 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:38.765647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:38.766059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:38.907695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:38.916919 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:38.918430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:38.919614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-48d09b6b-3f8c-4793-8b20-06df5ea45941 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.167656 Sep 13 15:37:38.920181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 566/759] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:38 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:39.947522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:39.948164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:39.955351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:39.955831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:39.956260 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:39.956961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:39.957452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:39.957867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:40.091895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:40.103182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:40.106492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:40.108505 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d30ec03-9d76-496a-b315-05b3a6410b4b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.165256 Sep 13 15:37:40.109070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 567/760] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:39 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:41.136238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:41.136996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:41.144539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:41.145300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:41.145994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:41.147110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:41.147793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:41.148406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:41.305107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:41.316667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:41.318143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:41.319892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-87c797cf-38ba-42fe-87e3-117088bb8765 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.189248 Sep 13 15:37:41.320485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 568/761] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:41 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:37:42.356922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:42.357963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:42.367284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:42.367762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:42.368256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:42.369281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:42.369824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:42.370276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:42.522477 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:42.531826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:42.533258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:42.534559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-104628ba-0fa4-4853-b33d-4ad565fb83c8 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.183670 Sep 13 15:37:42.535003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 569/762] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:42 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:43.563909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:43.564877 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:43.574455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:43.574937 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:43.579225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:43.579962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:43.580420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:43.580840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:43.714853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:43.725015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:43.726490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:43.727723 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d99a2cc-0002-48e8-b9f6-77d7936fc229 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.170377 Sep 13 15:37:43.728664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 570/763] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:43 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:44.757852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:44.758998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:44.770345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:44.771156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:44.771885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:44.773051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:44.773778 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:44.774549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:44.912271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:44.921203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:44.922686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:44.923845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-188525c4-f6f4-4b56-a503-5d2fee0c6ef1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.172609 Sep 13 15:37:44.924411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 571/764] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:44 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:45.961398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:45.962470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:45.973373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:45.974171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:45.974929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:45.976035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:45.976809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:45.977561 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:46.116647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:46.125485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:46.126966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:46.128125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a9d9e185-4b36-4d3a-ab72-20b4192282f6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.173356 Sep 13 15:37:46.128675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 572/765] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:45 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:47.166066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:47.166774 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:47.173810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:47.174337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:47.174768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:47.175459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:47.175938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:47.176357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:47.327206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:47.339442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:47.341703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:47.343509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-923ec019-3bc8-4dd6-9904-2133b0753b7e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.183594 Sep 13 15:37:47.344330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 573/766] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:47 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:48.371520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:48.372308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:48.379073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:48.379563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:48.380004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:48.380706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:48.381157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:48.381583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:48.521103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:48.530008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:48.531492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:48.532671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-edaf6245-e6cc-4028-b1ef-721c1c050e6c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.165872 Sep 13 15:37:48.533266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 574/767] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:48 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:49.563045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:49.564050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:49.574259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:49.574744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:49.575176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:49.575873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:49.576323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:49.576742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:49.715257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:49.723987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:49.725451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:49.726627 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e3aa844f-01c1-41c1-b3b1-1cd9560c40f4 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.170715 Sep 13 15:37:49.727213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 575/768] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:49 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:50.757380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:50.758490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:50.769004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:50.769481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:50.769906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:50.770628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:50.771163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:50.771833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:50.917252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:50.925640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:50.927112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:50.928272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-034ef4f4-e81b-4e2a-ac57-17d21d3c8217 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.177656 Sep 13 15:37:50.928829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 576/769] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:50 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:51.957659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:51.958806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:51.969614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:51.970518 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:51.971233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:51.972366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:51.973152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:51.973974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:52.126378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:52.131897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:37:52.140059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:52.142351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:52.144136 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c9adfc91-6e64-43de-94ef-43464290401c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.193257 Sep 13 15:37:52.144925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 577/770] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:51 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:53.173364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:53.174061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:53.181441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:53.181913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:53.182366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:53.183101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:53.183543 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:53.183961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:53.335987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:53.344375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:53.345814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:53.347014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-52fa5759-3809-40b7-b628-aae42355894e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.177989 Sep 13 15:37:53.347551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 578/771] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:53 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:54.376880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:54.377987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:54.388517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:54.389437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:54.389835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:54.390576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:54.391020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:54.391436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:54.525452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:54.534464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:54.536041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:54.537281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-13bf89ed-4c5d-4d0b-a87e-2be3ac653279 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.167131 Sep 13 15:37:54.537859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 579/772] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:54 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:55.565145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:55.565816 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:55.572258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:55.572759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:55.573232 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:55.573921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:55.574421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:55.574845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:55.721102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:55.734074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:55.736402 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:55.738198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ae51f288-3c0b-40d6-906c-113164506546 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.176944 Sep 13 15:37:55.738953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 580/773] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:55 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:56.770808 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:56.771649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:56.780003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:56.780606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:56.781152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:56.782017 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:56.782622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:56.783192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:56.920730 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:56.930358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:56.931793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:56.932944 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c1fdbde6-c829-4e54-8cec-084e12c235f7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.168142 Sep 13 15:37:56.933503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 581/774] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:56 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:57.963077 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:57.964164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:57.973123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:57.973611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:57.974050 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:57.974793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:57.975248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:57.975673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:58.113986 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:58.122836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:58.124584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:58.125759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6e0696a4-99c5-42b4-9b37-a58a127a8baf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.169309 Sep 13 15:37:58.126581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 582/775] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:57 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:59.152369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:37:59.152369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:37:59.158218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:59.158704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:59.159135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:59.159872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:59.160308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:59.160753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:59.298983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:59.307497 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:59.309485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:37:59.310744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f3ee8451-f3ca-4c63-a576-9d5c7cc61274 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.163700 Sep 13 15:37:59.311651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 583/776] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:37:59 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:37:59.317450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-c882cd18-a9c5-453d-985f-eb6835402f63 req-e0b0325d-3804-4962-ace8-f341890fc07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca18ccd-bba6-4f59-ac3a-61e4524607f0", "name": "network-vif-plugged", "status": "completed", "tag": "5a5700cd-ed56-489f-9724-206efe586022"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:37:59.327881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c882cd18-a9c5-453d-985f-eb6835402f63 req-e0b0325d-3804-4962-ace8-f341890fc07d service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:37:59.328450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c882cd18-a9c5-453d-985f-eb6835402f63 req-e0b0325d-3804-4962-ace8-f341890fc07d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:37:59.328882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-c882cd18-a9c5-453d-985f-eb6835402f63 req-e0b0325d-3804-4962-ace8-f341890fc07d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:37:59.340977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-c882cd18-a9c5-453d-985f-eb6835402f63 req-e0b0325d-3804-4962-ace8-f341890fc07d service nova] Creating event network-vif-plugged:5a5700cd-ed56-489f-9724-206efe586022 for instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 on hv-cinder-85743 Sep 13 15:37:59.346681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-c882cd18-a9c5-453d-985f-eb6835402f63 req-e0b0325d-3804-4962-ace8-f341890fc07d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Sep 13 15:37:59.347274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 584/777] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:00.338804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:00.339495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:00.346711 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:00.347194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:00.347622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:00.348315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:00.348758 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:00.349176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:00.491218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:00.499353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:00.501064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:00.502544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-06154bed-5b4c-4da8-a8ce-5fbfbf128b95 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.168484 Sep 13 15:38:00.503417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 585/778] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:00 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:01.528563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:01.529185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:01.536041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:01.536519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:01.536946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:01.537631 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:01.538076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:01.538525 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:01.677470 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:01.686296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:01.687740 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:01.689007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5a87acda-a439-46eb-ad5c-e124b6034e05 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.164349 Sep 13 15:38:01.689573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 586/779] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:01 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:02.719252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:02.720409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:02.727756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:02.728242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:02.728675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:02.729380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:02.729831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:02.730305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:02.869182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:02.878079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:02.879406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:02.880603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b3ed08a9-fa07-4199-89ad-b04b9277ea55 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1744 microversion: 2.20 time: 0.168508 Sep 13 15:38:02.881156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 587/780] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:02 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:03.906424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:03.907969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:03.915416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:03.916318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:03.916899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:03.917745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:03.918371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:03.918943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:04.098892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:04.107935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:04.109934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:04.112056 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0ab4d036-bda2-4b39-b9cf-ea9941021a2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.209902 Sep 13 15:38:04.112974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 588/781] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:03 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:05.139464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:05.141002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:05.148507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:05.149269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:05.149921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:05.150718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:05.151427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:05.152003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:05.305336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:05.316404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:05.318387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:05.319772 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e3bb7e9d-d6ee-42ac-b67b-5bfe819d085c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.184524 Sep 13 15:38:05.320660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 589/782] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:05 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:06.348380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:06.349517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:06.360179 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=55 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:06.361800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:06.362340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:06.367151 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:06.367888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:06.369080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:06.369684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:06.609763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:06.619247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:06.620694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:06.621883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ae29f48f-db3a-4ee8-aa8c-5de746428097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.278520 Sep 13 15:38:06.638652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 590/783] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:06 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:07.651451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:07.652185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:07.679507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:07.684699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:07.686752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:07.691229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:07.694546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:07.695599 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:07.901371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:07.911787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:07.913266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:07.914532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4305e2db-be96-44df-9296-b8f389fdaccf tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.269928 Sep 13 15:38:07.915653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 591/784] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:07 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:08.941229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:08.941881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:08.949118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:08.950394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:08.950906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:08.951696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:08.953464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:08.954041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:09.105153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:09.114600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:09.116193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:09.117479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b92ae46d-6fe3-4643-857a-ff961af29661 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.180547 Sep 13 15:38:09.118064 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 592/785] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:08 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:10.145082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:10.146496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:10.153258 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:10.153918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:10.154533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:10.155421 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:10.156041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:10.156638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:10.294752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:10.304371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:10.305813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:10.307169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-47b2dece-4fd7-48f0-a5ad-d6c60c1078a1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.166011 Sep 13 15:38:10.307917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 593/786] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:10 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:11.333101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:11.334802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:11.342139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:11.342907 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:11.343775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:11.344071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:11.345025 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:11.345748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:11.493223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:11.508058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:11.509915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:11.515468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2021fbe5-ef03-4f30-a607-365a97273fe6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.182687 Sep 13 15:38:11.516555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 594/787] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:11 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:12.541411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:12.542490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:12.550640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:12.551372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:12.551809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:12.552516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:12.552963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:12.553381 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:12.558062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:12.714983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:12.724389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:12.725864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:12.727058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-43aa32cc-17d3-4cdc-aaa0-f1e0460eacc9 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.189691 Sep 13 15:38:12.741038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 595/788] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:12 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:13.755293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:13.756014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:13.762959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:13.763541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:13.764016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:13.764781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:13.765287 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:13.765796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:13.905868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:13.915946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:13.917408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:13.918606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-31c49442-8f2d-446c-b0f4-4ac69a0bd193 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1739 microversion: 2.20 time: 0.168535 Sep 13 15:38:13.919168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 596/789] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:13 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:14.944623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:14.945296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:14.951800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:14.952635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:14.953073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:14.953779 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:14.954261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:14.954714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:15.108678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:15.117616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:15.119079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:15.120238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-56f31cad-5537-4471-8909-8015e5dbf11b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1721 microversion: 2.20 time: 0.179770 Sep 13 15:38:15.120796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 597/790] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:14 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:16.150490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:16.151106 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:16.159029 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:16.159571 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:16.160375 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:16.161359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:16.161883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:16.162399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:16.300154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:16.308946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:16.310414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:16.311584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cb38e9b1-121b-406a-a07b-12041cffe27b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1721 microversion: 2.20 time: 0.165964 Sep 13 15:38:16.312152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 598/791] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:16 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:17.338373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:17.339035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:17.346131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:17.346637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:17.347211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:17.348234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:17.348687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:17.349101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:17.492558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:17.502032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:17.503892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:17.505136 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e904eb38-38c3-499a-9cf4-b8e4da740f06 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1721 microversion: 2.20 time: 0.170758 Sep 13 15:38:17.505763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 599/792] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:17 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:17.606888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-361ac7fb-ac3e-4b59-aca6-42629c5abbe4 req-f995a086-da92-4eff-85f2-9ee71303e11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca18ccd-bba6-4f59-ac3a-61e4524607f0", "name": "network-vif-unplugged", "status": "completed", "tag": "5a5700cd-ed56-489f-9724-206efe586022"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:17.618268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-361ac7fb-ac3e-4b59-aca6-42629c5abbe4 req-f995a086-da92-4eff-85f2-9ee71303e11f service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:17.618745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-361ac7fb-ac3e-4b59-aca6-42629c5abbe4 req-f995a086-da92-4eff-85f2-9ee71303e11f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:17.619169 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-361ac7fb-ac3e-4b59-aca6-42629c5abbe4 req-f995a086-da92-4eff-85f2-9ee71303e11f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:17.630632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-361ac7fb-ac3e-4b59-aca6-42629c5abbe4 req-f995a086-da92-4eff-85f2-9ee71303e11f service nova] Creating event network-vif-unplugged:5a5700cd-ed56-489f-9724-206efe586022 for instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 on hv-cinder-85743 Sep 13 15:38:17.635850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-361ac7fb-ac3e-4b59-aca6-42629c5abbe4 req-f995a086-da92-4eff-85f2-9ee71303e11f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032714 Sep 13 15:38:17.636451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 600/793] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:18.532940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:18.533603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:18.540520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:18.541015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:18.541451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:18.542220 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:18.542640 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:18.543067 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:18.682219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:18.690413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:18.691967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:18.693321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-92d4b7c4-026c-4b99-b3d5-0b2806e59800 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1721 microversion: 2.20 time: 0.165516 Sep 13 15:38:18.693897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 601/794] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:18 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:19.718541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:19.719205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:19.726273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:19.726772 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:19.727177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:19.727846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:19.728293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:19.728708 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:19.861242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:19.869804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:19.871401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:19.872550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d683c04e-c084-45bb-915c-279452293d20 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1724 microversion: 2.20 time: 0.158136 Sep 13 15:38:19.873268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 602/795] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:19 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:19.897199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d99b3017-9cdf-45f8-878a-4943e967d326"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:19.899557 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:19.905590 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:19.906065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:19.906526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:19.907213 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:19.907661 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:19.908080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.199173 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-904dde59-8e91-4405-8f9a-3c1ef09c8ec3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305915 Sep 13 15:38:20.199785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 603/796] 10.222.0.16 () {62 vars in 1364 bytes} [Tue Sep 13 15:38:19 2022] POST /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 15:38:20.393842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:20.394343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:20.401002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.401311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.401741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.402551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.402918 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.403338 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.427207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-43d9bc65-b150-4c31-b922-66df1f2bf41d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/ips" status: 200 len: 151 microversion: 2.1 time: 0.226331 Sep 13 15:38:20.427760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 604/797] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:38:20 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/ips => generated 151 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:20.433137 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:20.433613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:20.439992 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.440606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.440923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.441637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.442041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.442492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.732836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-46f974da-b2f7-4e17-b38f-c8f0ee7f4524 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-volume_attachments/d99b3017-9cdf-45f8-878a-4943e967d326" status: 202 len: 0 microversion: 2.20 time: 0.303260 Sep 13 15:38:20.735181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 605/798] 10.222.0.16 () {60 vars in 1457 bytes} [Tue Sep 13 15:38:20 2022] DELETE /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-volume_attachments/d99b3017-9cdf-45f8-878a-4943e967d326 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:38:20.802787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:20.803472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:20.809567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.810059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.810537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.811199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.811671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.812060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.841694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120658) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 15:38:20.900352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:20.916268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2e45129b-a8df-4c74-9c8d-5b84a8900065 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "POST /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/action" status: 202 len: 0 microversion: 2.20 time: 0.117582 Sep 13 15:38:20.919885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 606/799] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Sep 13 15:38:20 2022] POST /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:38:20.925671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:20.926279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:20.933617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.934189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.934740 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:20.935428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:20.935858 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:20.936264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:21.102179 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:21.112296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:21.113724 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:21.114923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8bbba5d4-7aea-404c-b129-0e4d409bbe0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1672 microversion: 2.20 time: 0.193642 Sep 13 15:38:21.115519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 607/800] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:20 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:21.828962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3977f06a-2a62-49b0-b3e1-031beef88fa6"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:21.831443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:21.838011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:21.838552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:21.839039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:21.839739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:21.840267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:21.840600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:22.123006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-278da9c2-1397-4ed1-b2e1-2245e3dc7b7b tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298145 Sep 13 15:38:22.124073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 608/801] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:38:21 2022] POST /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:38:22.143378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:22.144093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:22.159589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:22.160094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:22.160587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:22.161432 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:22.162651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:22.163379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:22.313898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:22.328726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:22.330697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:22.332184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-44c9c9c3-17ef-432d-a4e1-1b5f84e13bf7 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.194594 Sep 13 15:38:22.338168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 609/802] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:22 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:23.358848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:23.359428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:23.367172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:23.367733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:23.368393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:23.369151 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:23.369601 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:23.370228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:23.528348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:23.536623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:23.538155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:23.539332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-816f406f-78f8-4b7a-b49e-6de54bfa7c82 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.184618 Sep 13 15:38:23.539880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 610/803] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:23 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:24.564781 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:24.565356 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:24.573363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:24.574076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:24.574545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:24.575247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:24.575694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:24.576236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:24.736456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:24.745271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:24.746896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:24.748525 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4da0a0e1-568d-42bd-a5a4-4bbfc7431c3e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.187841 Sep 13 15:38:24.749093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 611/804] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:24 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:25.775281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:25.775984 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:25.784455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:25.785194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:25.785805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:25.786635 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:25.787420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:25.787850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:25.929842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:25.938319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:25.939737 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:25.940894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-76d3c90f-2d10-4092-b2a1-a05a0fbf7ba1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.170457 Sep 13 15:38:25.941462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 612/805] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:25 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:26.972522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:26.973266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:26.982138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:26.982626 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:26.983218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:26.983987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:26.984576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:26.985039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:27.127487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:27.136749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:27.138867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:27.140080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7785b86e-766c-439b-98a8-5e52f5f0daa2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.171745 Sep 13 15:38:27.140657 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 613/806] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:26 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:28.168051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:28.169936 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:28.180430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:28.181075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:28.181606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:28.182446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:28.182997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:28.183513 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:28.327493 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:28.336053 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:28.337577 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:28.338886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1739f80c-54da-4796-8663-613912c30feb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.174966 Sep 13 15:38:28.339644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 614/807] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:28 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:29.365079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:29.365894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:29.375193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:29.375683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:29.376111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:29.376818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:29.377270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:29.377685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:29.523179 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:29.533080 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:29.534571 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:29.536094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fe9f049d-2e8e-4a79-8713-7871cfb1229e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.175011 Sep 13 15:38:29.536999 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 615/808] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:29 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:29.632239 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:38:29.632819 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:38:30.562467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:30.563059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:30.569953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:30.570894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:30.570894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:30.571619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:30.572071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:30.572841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:30.720946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:30.732891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:30.734430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:30.735309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b7db0751-180f-4b4d-96c5-4c63a5c0ca5b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.177393 Sep 13 15:38:30.750292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 616/809] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:30 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:31.761537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:31.762983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:31.770739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:31.771608 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:31.772395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:31.773330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:31.774127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:31.774680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:31.930362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:31.943170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:31.944616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:31.945818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fe655851-ee5d-402a-b02f-6dbb7e71a681 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.188913 Sep 13 15:38:31.946411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 617/810] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:31 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:32.973299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:32.973966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:32.980565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:32.981052 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:32.981486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:32.986866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:32.987531 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:32.988074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:33.139233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:33.148139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:33.149564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:33.150743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0e6e1f06-aece-49d5-b5ee-9d5a1ac76b2e tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.181750 Sep 13 15:38:33.151280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 618/811] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:32 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:34.177262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:34.178048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:34.185184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:34.185934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:34.186995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:34.187712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:34.188167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:34.188580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:34.337442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:34.349032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:34.351419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:34.353324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0b056bfd-fc2a-4595-8c5d-07fe13c113c6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.179800 Sep 13 15:38:34.354094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 619/812] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:34 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:35.380632 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:35.381286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:35.388316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:35.388852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:35.389295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:35.389996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:35.390467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:35.390887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:35.526625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:35.535651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:35.537097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:35.538293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6f836a93-51f1-4ac0-b30e-7480c16a3be5 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.161656 Sep 13 15:38:35.538848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 620/813] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:35 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:36.568429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:36.569660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:36.573480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:36.580648 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:36.581130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:36.581559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:36.582280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:36.582731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:36.583152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:36.740306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:36.748803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:36.750269 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:36.751437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cae29b41-eca5-446c-8136-a9028f914fb3 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.189732 Sep 13 15:38:36.752001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 621/814] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:36 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:37.776753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:37.777378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:37.783990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:37.784463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:37.784897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:37.785572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:37.786017 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:37.786461 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:37.788954 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:37.919968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:37.928361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:37.929835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:37.931028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eed2a9e3-50a7-4980-af24-eb57544a3fd1 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.158279 Sep 13 15:38:37.931588 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 622/815] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:37 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:38:38.957427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:38.958066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:38.964769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:38.965246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:38.965678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:38.966398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:38.966845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:38.967264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:39.108366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:39.116832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:39.118322 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:39.119488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-18e98ad5-edb8-4f1d-91f4-bf02ac6ad097 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.166160 Sep 13 15:38:39.120058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 623/816] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:38 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:40.144424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:40.145076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:40.151841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.152323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.152749 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.153446 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.153871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.154324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.292839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:40.301930 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:40.303422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:40.304637 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-548b5b27-47ca-4f48-9f81-0d75286aa047 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.164386 Sep 13 15:38:40.305209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 624/817] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:40 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:40.309617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:40.310127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:40.316671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.317165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.317598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.318324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.318814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.319207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.344157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-187c2e65-7a02-4db1-b07e-f1a34bfd31c4 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/ips" status: 200 len: 145 microversion: 2.1 time: 0.037882 Sep 13 15:38:40.350284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 625/818] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:38:40 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:40.412950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3977f06a-2a62-49b0-b3e1-031beef88fa6"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:40.415441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:40.421301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.421783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.422248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.422943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.423396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.423814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.511139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Invalid volume: volume 3977f06a-2a62-49b0-b3e1-031beef88fa6 is already attached to instances: 30d53a86-9ab1-43c5-a755-d1ccb689be99 Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: POST /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments HTTP/1.1 Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 74 Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:38:40.512890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {"volumeAttachment": {"volumeId": "3977f06a-2a62-49b0-b3e1-031beef88fa6"}} Sep 13 15:38:40.514582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Invalid volume: volume 3977f06a-2a62-49b0-b3e1-031beef88fa6 is already attached to instances: 30d53a86-9ab1-43c5-a755-d1ccb689be99 Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'server_id': '30d53a86-9ab1-43c5-a755-d1ccb689be99', 'body': {'volumeAttachment': {'volumeId': '3977f06a-2a62-49b0-b3e1-031beef88fa6'}}} Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3977f06a-2a62-49b0-b3e1-031beef88fa6 is already attached to instances: 30d53a86-9ab1-43c5-a755-d1ccb689be99 Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:40.515600 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3977f06a-2a62-49b0-b3e1-031beef88fa6 is already attached to instances: 30d53a86-9ab1-43c5-a755-d1ccb689be99 Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:38:40.516803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3977f06a-2a62-49b0-b3e1-031beef88fa6 is already attached to instances: 30d53a86-9ab1-43c5-a755-d1ccb689be99 Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 400 to user: Invalid volume: volume 3977f06a-2a62-49b0-b3e1-031beef88fa6 is already attached to instances: 30d53a86-9ab1-43c5-a755-d1ccb689be99 {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ad582a65-3ef9-442f-bc74-e61c3dd0bb45 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105512 Sep 13 15:38:40.518019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 626/819] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:38:40 2022] POST /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 15:38:40.592366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:40.593478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:40.599979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.600435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.600844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.601562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.602035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.602604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.693564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lazy-loading 'services' on Instance uuid 30d53a86-9ab1-43c5-a755-d1ccb689be99 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:38:40.769902 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b18e7db8-71d6-46c2-abab-d85d00f74f88 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments/3977f06a-2a62-49b0-b3e1-031beef88fa6" status: 202 len: 0 microversion: 2.1 time: 0.181974 Sep 13 15:38:40.770601 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 627/820] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:38:40 2022] DELETE /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments/3977f06a-2a62-49b0-b3e1-031beef88fa6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:38:40.780111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:40.782835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:40.789685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.790364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.790803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.791582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:40.792133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:40.793041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:40.823463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e7c1ff95-0644-4fef-92f2-9d050713ade0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047575 Sep 13 15:38:40.824016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 628/821] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:38:40 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:38:41.332268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:41.332985 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:41.340703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:41.341252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:41.341832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:41.342568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:41.343013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:41.343769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:41.503102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:41.513422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:41.514900 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:41.516511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1408cfe7-60e7-45d3-9bf4-45dfd87e2cbb tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.188833 Sep 13 15:38:41.517252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 629/822] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:41 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:41.521858 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-1ef3ba2d-3ea4-4ff5-8fe1-cb5896c8c532 req-0c589874-0845-4e12-b5d1-fc1ae42f69c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca18ccd-bba6-4f59-ac3a-61e4524607f0", "name": "network-vif-plugged", "status": "completed", "tag": "5a5700cd-ed56-489f-9724-206efe586022"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:41.535817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1ef3ba2d-3ea4-4ff5-8fe1-cb5896c8c532 req-0c589874-0845-4e12-b5d1-fc1ae42f69c0 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:41.536347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1ef3ba2d-3ea4-4ff5-8fe1-cb5896c8c532 req-0c589874-0845-4e12-b5d1-fc1ae42f69c0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:41.536773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1ef3ba2d-3ea4-4ff5-8fe1-cb5896c8c532 req-0c589874-0845-4e12-b5d1-fc1ae42f69c0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:41.548737 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-1ef3ba2d-3ea4-4ff5-8fe1-cb5896c8c532 req-0c589874-0845-4e12-b5d1-fc1ae42f69c0 service nova] Creating event network-vif-plugged:5a5700cd-ed56-489f-9724-206efe586022 for instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 on hv-cinder-85743 Sep 13 15:38:41.554273 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-1ef3ba2d-3ea4-4ff5-8fe1-cb5896c8c532 req-0c589874-0845-4e12-b5d1-fc1ae42f69c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035537 Sep 13 15:38:41.554902 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 630/823] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:41.838748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:41.841506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:41.850874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:41.851711 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:41.852541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:41.854531 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:41.855276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:41.855731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:41.892808 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-199610ec-d07a-4708-a184-33589e98bf3e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059199 Sep 13 15:38:41.893362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 631/824] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:38:41 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:42.544698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:42.545382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:42.552496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:42.553011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:42.553439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:42.554134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:42.554606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:42.555013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:42.697150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:42.708457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:42.709915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:42.711110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-44a6e56c-8551-4d6d-ab24-7ab64918904c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.170535 Sep 13 15:38:42.711675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 632/825] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:42 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:42.806807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f46314a3-411b-4e13-a594-1af9dab52007"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:42.809209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:42.815415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:42.815899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:42.816328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:42.817010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:42.817454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:42.817869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.204675 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7e051a78-5c4d-4fb9-98f4-7a22b6eae318 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401755 Sep 13 15:38:43.205325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 633/826] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:38:42 2022] POST /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:38:43.210527 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:43.213373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:43.220249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.220755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.221195 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.221906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.222394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.222819 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.254997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d1eb2931-91a6-42ba-8cab-02428358f746 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048472 Sep 13 15:38:43.255569 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 634/827] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:38:43 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:38:43.318821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:43.319290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:43.325261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.325742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.326551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.327265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.327700 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.328125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.353253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:38:43.434070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-81246a0d-772e-45de-8b1e-eda9521c0b44 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 204 len: 0 microversion: 2.1 time: 0.118941 Sep 13 15:38:43.434713 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 635/828] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:38:43 2022] DELETE /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 15:38:43.443175 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:43.443842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:43.449441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.449921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.450389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.451430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.451884 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.452311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.467991 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:43.591242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:43.602130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2619ee89-c14e-4400-8aad-11869fbea785 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1683 microversion: 2.1 time: 0.162749 Sep 13 15:38:43.603002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 636/829] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:43 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:38:43.737166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:43.737783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:43.744677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.745167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.745601 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.746352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:43.746870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:43.747292 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:43.885606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:43.898165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:43.900427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:43.902296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-878e252b-7e12-4392-8dde-826ccb083fc0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.169313 Sep 13 15:38:43.902907 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 637/830] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:43 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:44.633280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:44.634394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:44.645970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:44.646842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:44.647560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:44.648715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:44.649479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:44.650456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:44.805811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:44.818087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c91aa307-5e7d-4789-8ca7-bec00b6931f9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1683 microversion: 2.1 time: 0.191815 Sep 13 15:38:44.818887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 638/831] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:44 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:38:44.933409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:44.934439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:44.944433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:44.945227 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:44.945934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:44.947293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:44.948042 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:44.948741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:45.091970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:45.101001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:45.101910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:45.103172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3a6b703f-3aa9-40e6-bfaf-0a277e8a5e7f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1730 microversion: 2.20 time: 0.176160 Sep 13 15:38:45.103754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 639/832] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:44 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:45.845832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:45.846923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:45.857874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:45.858732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:45.859491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:45.860623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:45.861424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:45.861851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:46.279751 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:46.294063 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1818baf6-5858-42c0-aedb-58d3cd4b1c8d tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1683 microversion: 2.1 time: 0.454803 Sep 13 15:38:46.294859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 640/833] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:45 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1683 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:38:46.300304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:46.301027 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:46.307224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:46.307804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:46.308379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:46.309247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:46.309800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:46.310366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:46.453505 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:46.461426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:46.462959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:46.464127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7747183e-ec31-40a0-a745-c2f39826cd0f tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1717 microversion: 2.20 time: 0.168136 Sep 13 15:38:46.464668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 641/834] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:38:46 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:38:46.847364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-4ce1ccac-e130-4d7f-831e-a7fd612a0926 req-e39eaa86-336c-4c7a-87f7-54cd26edd124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d53a86-9ab1-43c5-a755-d1ccb689be99", "name": "network-vif-deleted", "tag": "a8e08ac3-21a0-4069-81e3-37a7f32cff29"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:46.857977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4ce1ccac-e130-4d7f-831e-a7fd612a0926 req-e39eaa86-336c-4c7a-87f7-54cd26edd124 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:46.858490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4ce1ccac-e130-4d7f-831e-a7fd612a0926 req-e39eaa86-336c-4c7a-87f7-54cd26edd124 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:46.858981 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4ce1ccac-e130-4d7f-831e-a7fd612a0926 req-e39eaa86-336c-4c7a-87f7-54cd26edd124 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:46.871973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-4ce1ccac-e130-4d7f-831e-a7fd612a0926 req-e39eaa86-336c-4c7a-87f7-54cd26edd124 service nova] Creating event network-vif-deleted:a8e08ac3-21a0-4069-81e3-37a7f32cff29 for instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 on hv-cinder-85743 Sep 13 15:38:46.878376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-4ce1ccac-e130-4d7f-831e-a7fd612a0926 req-e39eaa86-336c-4c7a-87f7-54cd26edd124 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036266 Sep 13 15:38:46.878990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 642/835] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:38:47.319097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:47.319889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:47.331825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:47.332319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:47.332753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:47.333465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:47.333905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:47.334359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:47.385836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:47.386340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:47.386768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:47.387212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lazy-loading 'fault' on Instance uuid 30d53a86-9ab1-43c5-a755-d1ccb689be99 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:38:47.434591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:47.445372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-267fe597-5b72-42ea-a4bd-7ace25915b2e tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 200 len: 1331 microversion: 2.1 time: 0.130605 Sep 13 15:38:47.446171 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 643/836] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:47 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:38:48.470219 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:48.470787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:48.477348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:48.477817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:48.478305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:48.478967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:48.479413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:48.479849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:48.492994 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 HTTP/1.1 Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:38:48.494667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:38:48.496204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '30d53a86-9ab1-43c5-a755-d1ccb689be99'} Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:38:48.497301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:38:48.498821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:38:48.500216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:38:48.500216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e67d5430-e940-4b46-8327-098870ef77f6 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 404 len: 111 microversion: 2.1 time: 0.030019 Sep 13 15:38:48.500216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 644/837] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:48 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:38:48.505048 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-00f22a91-3755-43c3-a47f-712269c7bbab tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '.version_select at 0x7f4bbf3a1b80>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:48.527039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-00f22a91-3755-43c3-a47f-712269c7bbab tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654696155" status: 202 len: 0 microversion: 2.1 time: 0.025975 Sep 13 15:38:48.527692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 645/838] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Sep 13 15:38:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654696155 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:38:49.192983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0df71a70-ef3b-4684-acb0-6fd8866df5a8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: .version_select at 0x7f4bbf671040>, body: {"keypair": {"name": "tempest-keypair-852772945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbPiVEl4V/oM07GTYvasqoKj97rXypLzuIyqnXuloxp6HfgAzC71NQNRSI9FooGfyg/LJFWv/KFKa47EOFx8lQWdN7b632x14OEAP7o7fe0E8LObVzqKsRSaq0TueNhgg=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:49.209988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-0df71a70-ef3b-4684-acb0-6fd8866df5a8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:38:49.213925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-0df71a70-ef3b-4684-acb0-6fd8866df5a8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:38:49.241373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0df71a70-ef3b-4684-acb0-6fd8866df5a8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052395 Sep 13 15:38:49.246709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 646/839] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:38:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:50.551962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-643341303", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dae42ed5-9203-4331-a516-9ad32fc49ad2"}], "security_groups": [{"name": "tempest-securitygroup--539940582"}], "key_name": "tempest-keypair-852772945", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:50.667260 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] validate_networks() for [('dae42ed5-9203-4331-a516-9ad32fc49ad2', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:38:51.053236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:38:51.053659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:38:51.054179 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:38:51.054579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:38:51.054993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:38:51.064878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:51.065379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:51.065804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:51.066578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:51.067033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:51.067459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:51.087297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:38:51.092095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Getting quotas for user f48ce3ac32e741ef98e5025fd23bbaa0 and project 76163bf55e0a403aaec08c9c6a68a55f. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:38:51.104167 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:38:51.106627 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:38:51.161119 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-991a514e-94a5-4b94-a93a-ffa88a06fe55 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612733 Sep 13 15:38:51.162420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 647/840] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:38:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:38:51.178560 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-438499cc-6b73-4301-abc1-18f9e082c6ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:51.179597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-438499cc-6b73-4301-abc1-18f9e082c6ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:51.237193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-438499cc-6b73-4301-abc1-18f9e082c6ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:51.245288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-438499cc-6b73-4301-abc1-18f9e082c6ca tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1240 microversion: 2.1 time: 0.075188 Sep 13 15:38:51.245931 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 648/841] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:51 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:38:51.905040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:51.908194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:51.916001 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:51.916490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:51.916926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:51.917630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:51.918092 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:51.918547 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:51.949878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c0c051be-6daa-40ed-ad80-988941b1e9c6 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048810 Sep 13 15:38:51.950832 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 649/842] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:38:51 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:38:51.961873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:51.962417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:51.968401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:51.968875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:51.969320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:51.969995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:51.970595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:51.971012 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:51.999733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-027cbbf3-0073-4505-a43f-f2b693201a30 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/f46314a3-411b-4e13-a594-1af9dab52007" status: 200 len: 194 microversion: 2.1 time: 0.041505 Sep 13 15:38:52.000468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 650/843] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Sep 13 15:38:51 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/f46314a3-411b-4e13-a594-1af9dab52007 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:52.270251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:52.271165 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:52.280503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:52.281222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:52.281809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:52.282695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:52.283407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:52.284034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:52.368892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:52.378215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-75e07a9e-f2bc-488d-abeb-c92569865e24 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1300 microversion: 2.1 time: 0.113134 Sep 13 15:38:52.379056 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 651/844] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:52 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:38:52.727049 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:38:52.727705 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:38:53.368780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32abc212-1eaa-4509-a269-c91371fe2a81"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:53.371250 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:53.373871 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:53.379459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:53.379987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:53.380452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:53.381229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:53.381673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:53.382124 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:53.674556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-362cb73e-ff4c-4a58-b226-7e4badd1d252 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "POST /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309604 Sep 13 15:38:53.681183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 652/845] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:38:53 2022] POST /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:53.681183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:53.681415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:53.689209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:53.690130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:53.690277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:53.690941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:53.691319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:53.691747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:53.903118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:53.913494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-33be0693-6b2c-401d-b678-07b2fa5c4255 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.236868 Sep 13 15:38:53.914868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 653/846] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:53 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:38:53.919591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-8a2c16e8-c107-4c42-a974-e671f040854c req-d8284638-fd2c-494e-82b3-0c7badf40859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100b4bbd-17e4-45ff-8606-e36f2eeda69d", "tag": "2d308a79-d4e3-4650-921d-5f3b094974f4"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:38:53.929882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8a2c16e8-c107-4c42-a974-e671f040854c req-d8284638-fd2c-494e-82b3-0c7badf40859 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:53.930609 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8a2c16e8-c107-4c42-a974-e671f040854c req-d8284638-fd2c-494e-82b3-0c7badf40859 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:53.930858 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8a2c16e8-c107-4c42-a974-e671f040854c req-d8284638-fd2c-494e-82b3-0c7badf40859 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:53.941978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-8a2c16e8-c107-4c42-a974-e671f040854c req-d8284638-fd2c-494e-82b3-0c7badf40859 service nova] Creating event network-changed:2d308a79-d4e3-4650-921d-5f3b094974f4 for instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d on hv-cinder-85743 Sep 13 15:38:53.946776 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-8a2c16e8-c107-4c42-a974-e671f040854c req-d8284638-fd2c-494e-82b3-0c7badf40859 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030644 Sep 13 15:38:53.947539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 654/847] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:38:54.939765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:54.940478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:54.946765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:54.947255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:54.947687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:54.948379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:54.948827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:54.949246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:55.082911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:55.090642 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9ceb4be3-4fea-4a1c-8a47-0b76c1657001 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.155757 Sep 13 15:38:55.091197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 655/848] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:54 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:38:56.114010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:56.114690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:56.121783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:56.122312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:56.122943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:56.123815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:56.124437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:56.124861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:56.377025 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:56.380497 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:38:56.390528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-756a5767-c0ac-4167-9e15-a51c013df9a9 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.281370 Sep 13 15:38:56.391074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 656/849] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:56 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:38:57.420079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:57.421593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:57.429351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:57.430351 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:57.430942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:57.432032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:57.432644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:57.433382 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:57.604524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:57.615520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-67977ae5-3609-471d-b8db-51dcace33fa5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.202178 Sep 13 15:38:57.616365 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 657/850] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:57 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:38:58.642712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:58.643534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:58.653249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:58.653840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:58.654508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:58.655441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:58.656086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:58.656697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:58.823436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:38:58.833674 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6baf8782-8389-40a8-8441-dd14dbb7e886 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.197333 Sep 13 15:38:58.834412 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 658/851] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:58 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:38:59.857163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:38:59.857776 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:38:59.865795 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:59.866506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:59.866965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:38:59.867671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:38:59.868116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:38:59.868533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:00.034947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:00.046049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bd5ab2f6-2717-4c0a-9f0e-4893e33189cb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.192442 Sep 13 15:39:00.047241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 659/852] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:38:59 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:39:00.052948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-8be4d1b0-5570-41e6-9379-d00749c62241 req-03aa4e22-f7de-4e3e-8b7c-388e447a89b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100b4bbd-17e4-45ff-8606-e36f2eeda69d", "name": "network-vif-plugged", "status": "completed", "tag": "2d308a79-d4e3-4650-921d-5f3b094974f4"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:00.065844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8be4d1b0-5570-41e6-9379-d00749c62241 req-03aa4e22-f7de-4e3e-8b7c-388e447a89b4 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:00.066744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8be4d1b0-5570-41e6-9379-d00749c62241 req-03aa4e22-f7de-4e3e-8b7c-388e447a89b4 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:00.067410 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8be4d1b0-5570-41e6-9379-d00749c62241 req-03aa4e22-f7de-4e3e-8b7c-388e447a89b4 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:00.086200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-8be4d1b0-5570-41e6-9379-d00749c62241 req-03aa4e22-f7de-4e3e-8b7c-388e447a89b4 service nova] Creating event network-vif-plugged:2d308a79-d4e3-4650-921d-5f3b094974f4 for instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d on hv-cinder-85743 Sep 13 15:39:00.095762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-8be4d1b0-5570-41e6-9379-d00749c62241 req-03aa4e22-f7de-4e3e-8b7c-388e447a89b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044537 Sep 13 15:39:00.096545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 660/853] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:01.078140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:01.080008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:01.083928 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:01.088593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.089150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.089644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.090428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.090938 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.091549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.242685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=12 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:01.290557 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:01.300335 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-00b81371-274b-4235-90ee-c195bc73fab8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.233394 Sep 13 15:39:01.300927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 661/854] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:01 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:01.364086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:01.366300 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:01.372207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.372686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.373111 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.374005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.374474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.374889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.406419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eb32f797-7bdf-40cb-a5a9-3b3d5c651992 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046642 Sep 13 15:39:01.407387 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 662/855] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:39:01 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:39:01.555230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:01.556018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:01.561966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.562659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.563397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.564237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.565020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.565509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.605591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-af15356d-4678-49b0-a718-6643b6833ae9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/f46314a3-411b-4e13-a594-1af9dab52007" status: 200 len: 194 microversion: 2.1 time: 0.055690 Sep 13 15:39:01.606565 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 663/856] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Sep 13 15:39:01 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/f46314a3-411b-4e13-a594-1af9dab52007 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:01.638349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:01.638913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:01.646307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.647103 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.648645 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.649706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:01.651958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:01.652534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:01.792545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lazy-loading 'services' on Instance uuid 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:39:01.923961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-aff030ea-1c43-428f-a0a3-c1b426529fb3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/f46314a3-411b-4e13-a594-1af9dab52007" status: 202 len: 0 microversion: 2.1 time: 0.306507 Sep 13 15:39:01.925315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 664/857] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:39:01 2022] DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/f46314a3-411b-4e13-a594-1af9dab52007 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:39:02.326804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:02.327509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:02.335349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:02.336185 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:02.336834 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:02.338193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:02.338972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:02.339400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:02.505773 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:02.516697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c53ffe15-722f-443d-b64c-1e03d8539106 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1365 microversion: 2.1 time: 0.196063 Sep 13 15:39:02.532188 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 665/858] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:02 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:03.540593 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:03.541304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:03.556092 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:03.556602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:03.557040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:03.557758 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:03.558256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:03.558686 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:03.911629 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:03.928543 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8972ee59-6020-4b44-a061-d56b46ba1eb0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1556 microversion: 2.1 time: 0.392307 Sep 13 15:39:03.943929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 666/859] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:03 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1556 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:03.957392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:03.958256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:03.965249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:03.965962 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:03.966577 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:03.967465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:03.968393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:03.968973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:04.099647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e4bf31ac-9875-42e0-806c-5e4624e4547c tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146970 Sep 13 15:39:04.106180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 667/860] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Sep 13 15:39:03 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:04.174839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:04.175226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:04.187210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:04.187701 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:04.188135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:04.189118 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:04.189652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:04.189976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:04.243209 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-db9876ac-8a99-44a5-8322-88c1ff7e86ac tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/32abc212-1eaa-4509-a269-c91371fe2a81" status: 200 len: 194 microversion: 2.1 time: 0.072421 Sep 13 15:39:04.244157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 668/861] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Sep 13 15:39:04 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/32abc212-1eaa-4509-a269-c91371fe2a81 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:04.257224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:04.258168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:04.276682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:04.277579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:04.278325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:04.279278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:04.280326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:04.281193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:04.416021 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lazy-loading 'services' on Instance uuid 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:39:04.583597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8f1fc7ac-d631-4d49-b187-1889925581be tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/32abc212-1eaa-4509-a269-c91371fe2a81" status: 202 len: 0 microversion: 2.1 time: 0.331398 Sep 13 15:39:04.609461 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 669/862] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:39:04 2022] DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments/32abc212-1eaa-4509-a269-c91371fe2a81 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:39:05.684452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-df371640-aa38-45de-a0b0-08aa8333a54f req-322dbd1d-aa5e-4113-8bb7-f81c7e0a2b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100b4bbd-17e4-45ff-8606-e36f2eeda69d", "tag": "2d308a79-d4e3-4650-921d-5f3b094974f4"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:05.695910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-df371640-aa38-45de-a0b0-08aa8333a54f req-322dbd1d-aa5e-4113-8bb7-f81c7e0a2b7a service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:05.696400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-df371640-aa38-45de-a0b0-08aa8333a54f req-322dbd1d-aa5e-4113-8bb7-f81c7e0a2b7a service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:05.696831 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-df371640-aa38-45de-a0b0-08aa8333a54f req-322dbd1d-aa5e-4113-8bb7-f81c7e0a2b7a service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:05.709759 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-df371640-aa38-45de-a0b0-08aa8333a54f req-322dbd1d-aa5e-4113-8bb7-f81c7e0a2b7a service nova] Creating event network-changed:2d308a79-d4e3-4650-921d-5f3b094974f4 for instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d on hv-cinder-85743 Sep 13 15:39:05.715130 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-df371640-aa38-45de-a0b0-08aa8333a54f req-322dbd1d-aa5e-4113-8bb7-f81c7e0a2b7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037722 Sep 13 15:39:05.716400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 670/863] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:06.007453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-67961e6a-02ab-464e-9b46-edd55265197f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Action: 'create', calling method: .version_select at 0x7f4bbf5f1a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1900090519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLh3c8D7I6cf/1K8ItbKEaDo8SObS6nWmXpSWQzwlmbGrzfQ16nR+02dKelQhL7vlqA5/51GRUWXkLcu4Pb5fB44TXAKYyD8gbg2aSflqnRbR9zXVpxrJUDUOn2KwQn/A=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:06.027979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-67961e6a-02ab-464e-9b46-edd55265197f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Getting quotas for project 7eb316ace93e48c68ade74e9c5fccbf8. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:39:06.033098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-67961e6a-02ab-464e-9b46-edd55265197f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Getting quotas for user cb98650b97664e0cbac0f574163b8c40 and project 7eb316ace93e48c68ade74e9c5fccbf8. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:39:06.080068 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-67961e6a-02ab-464e-9b46-edd55265197f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.362185 Sep 13 15:39:06.080946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 671/864] 10.222.0.16 () {60 vars in 1159 bytes} [Tue Sep 13 15:39:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:06.087875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:06.090935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:06.099380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.100260 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.100714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.101997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.102563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.103000 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.178941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7f07497b-a1d1-4d23-a379-eee46a02a04b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089020 Sep 13 15:39:06.185667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 672/865] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:39:06 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:39:06.370643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:06.373152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:06.397004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.404361 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.405863 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.407093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.409806 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.410794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.480487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0f2ad242-a097-4987-b53d-26c8fb59913e tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114735 Sep 13 15:39:06.482249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 673/866] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:39:06 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:39:06.561485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:06.562332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:06.568923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.569673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.570366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.571251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.571864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.572537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.601610 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:39:06.610082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:06.723922 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6865f6ae-91bf-4329-9971-e11d1aa4de6b tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 204 len: 0 microversion: 2.1 time: 0.166009 Sep 13 15:39:06.728162 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 674/867] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:39:06 2022] DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 15:39:06.736966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:06.737809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:06.744416 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.744915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.745350 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.746232 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:06.746541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:06.747145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:06.956116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:06.965047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-337a1962-d31d-479d-a305-e8d270c4d536 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1672 microversion: 2.1 time: 0.235133 Sep 13 15:39:06.966062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 675/868] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:06 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1672 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:07.989481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:07.990199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:07.997194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:07.997676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:07.998096 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:07.998816 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:07.999259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:07.999680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:08.147973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:08.157367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fd2535ea-2067-42cb-8251-135d3f3a40c3 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1672 microversion: 2.1 time: 0.172124 Sep 13 15:39:08.158346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 676/869] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:07 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:39:09.183617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:09.184255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:09.192847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:09.193439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:09.193934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:09.195036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:09.196423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:09.197058 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:09.457766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:09.466284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-89f761dd-57dd-45c4-920a-186798f8e4da tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1672 microversion: 2.1 time: 0.286598 Sep 13 15:39:09.466864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 677/870] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:09 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1672 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:10.115881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-f7d5d27c-2809-4f46-88f7-196c418bf3b9 req-6325cf5d-cc26-4cc6-b810-eb61fc7249ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee29b76-b8d1-4887-b427-fdb42f9a7bb2", "name": "network-vif-deleted", "tag": "06e93362-26cb-407c-9bce-1c6ee8605997"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:10.129595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f7d5d27c-2809-4f46-88f7-196c418bf3b9 req-6325cf5d-cc26-4cc6-b810-eb61fc7249ef service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:10.130274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f7d5d27c-2809-4f46-88f7-196c418bf3b9 req-6325cf5d-cc26-4cc6-b810-eb61fc7249ef service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:10.137107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f7d5d27c-2809-4f46-88f7-196c418bf3b9 req-6325cf5d-cc26-4cc6-b810-eb61fc7249ef service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:10.150413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-f7d5d27c-2809-4f46-88f7-196c418bf3b9 req-6325cf5d-cc26-4cc6-b810-eb61fc7249ef service nova] Creating event network-vif-deleted:06e93362-26cb-407c-9bce-1c6ee8605997 for instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 on hv-cinder-85743 Sep 13 15:39:10.160740 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-f7d5d27c-2809-4f46-88f7-196c418bf3b9 req-6325cf5d-cc26-4cc6-b810-eb61fc7249ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049472 Sep 13 15:39:10.161534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 678/871] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:10.490427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:10.491970 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:10.498473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:10.499016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:10.499450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:10.500152 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:10.500841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:10.501500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:10.534945 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:10.535459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:10.535889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:10.536317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lazy-loading 'fault' on Instance uuid 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:39:10.587286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02aec8271af4bf7aea728ff92fa555b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b9e023e324874ac5f24ee571d1f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:10.595321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8057f888-60ef-4c0e-b9d4-7a797a5518b9 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 200 len: 1327 microversion: 2.1 time: 0.109884 Sep 13 15:39:10.595921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 679/872] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:10 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:39:11.618198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:11.618867 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:11.637220 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:11.638891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:11.639277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:11.642288 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:11.642842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:11.643291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:11.661809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] HTTP exception thrown: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Request method failure captured: Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 HTTP/1.1 Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKH5_I4ESPV3QyR1qaywLY2z-bpxdrHfRhQH_ZQvE6iUkGbwuBd1SQBXLBatRUFQrnfDELM7MxSRp63__Hsfq2Wdb9tFef15S6d5NYavEJrowXg44Au_DjF6TWB1MIgCliO1vBC-no6JBHJL7SPa25uCkSGIRBo_HAD2FjYjxJGixH8 Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:11.664006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}] Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c02aec8271af4bf7aea728ff92fa555b Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:11.665396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '0ee29b76-b8d1-4887-b427-fdb42f9a7bb2'} Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:11.666210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:11.667506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:11.668658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Returning 404 to user: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:11.668658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ce639d38-a979-4fa2-ac37-f7b637f33f81 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 404 len: 111 microversion: 2.1 time: 0.051204 Sep 13 15:39:11.668658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 680/873] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:11 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:39:11.676325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ee3eb189-d44e-4c59-8ec1-3566cf587622 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '.version_select at 0x7f4bc2e38940>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:11.698088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ee3eb189-d44e-4c59-8ec1-3566cf587622 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746554532" status: 202 len: 0 microversion: 2.1 time: 0.025615 Sep 13 15:39:11.702550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 681/874] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Sep 13 15:39:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746554532 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:39:14.674906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:14.676224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:14.683192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:14.683677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:14.684105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:14.684800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:14.685260 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:14.685678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:14.699714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] HTTP exception thrown: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Request method failure captured: Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 HTTP/1.1 Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKH5_I4ESPV3QyR1qaywLY2z-bpxdrHfRhQH_ZQvE6iUkGbwuBd1SQBXLBatRUFQrnfDELM7MxSRp63__Hsfq2Wdb9tFef15S6d5NYavEJrowXg44Au_DjF6TWB1MIgCliO1vBC-no6JBHJL7SPa25uCkSGIRBo_HAD2FjYjxJGixH8 Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:14.701265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}] Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c02aec8271af4bf7aea728ff92fa555b Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.702866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '0ee29b76-b8d1-4887-b427-fdb42f9a7bb2'} Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:14.703716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.705060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.706476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Returning 404 to user: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:14.706476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-727284a5-2c8f-428d-8e93-aea2b392ab82 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 404 len: 111 microversion: 2.1 time: 0.032788 Sep 13 15:39:14.706476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 682/875] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:39:14 2022] DELETE /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:39:14.711193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:14.711874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:14.718035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:14.718557 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:14.718990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:14.720430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:14.720888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:14.721317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:14.734979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] HTTP exception thrown: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Request method failure captured: Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 HTTP/1.1 Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKH5_I4ESPV3QyR1qaywLY2z-bpxdrHfRhQH_ZQvE6iUkGbwuBd1SQBXLBatRUFQrnfDELM7MxSRp63__Hsfq2Wdb9tFef15S6d5NYavEJrowXg44Au_DjF6TWB1MIgCliO1vBC-no6JBHJL7SPa25uCkSGIRBo_HAD2FjYjxJGixH8 Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:14.737420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}] Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c02aec8271af4bf7aea728ff92fa555b Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.738942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '0ee29b76-b8d1-4887-b427-fdb42f9a7bb2'} Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:14.740032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. Sep 13 15:39:14.741567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:14.743016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Returning 404 to user: Instance 0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:14.743016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-15492346-3633-434e-b616-4fe1148a8e5f tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2" status: 404 len: 111 microversion: 2.1 time: 0.031330 Sep 13 15:39:14.743016 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 683/876] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:14 2022] GET /compute/v2.1/servers/0ee29b76-b8d1-4887-b427-fdb42f9a7bb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:39:15.894444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:15.895148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:15.902146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:15.902653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:15.903087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:15.903793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:15.904249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:15.904673 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:15.920314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] HTTP exception thrown: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Request method failure captured: Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae HTTP/1.1 Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKH5_I4ESPV3QyR1qaywLY2z-bpxdrHfRhQH_ZQvE6iUkGbwuBd1SQBXLBatRUFQrnfDELM7MxSRp63__Hsfq2Wdb9tFef15S6d5NYavEJrowXg44Au_DjF6TWB1MIgCliO1vBC-no6JBHJL7SPa25uCkSGIRBo_HAD2FjYjxJGixH8 Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:15.921862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}] Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c02aec8271af4bf7aea728ff92fa555b Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '05da62b3-a8ec-4148-b17b-2c08f0e0d2ae'} Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:15.924312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.925611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.926866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Returning 404 to user: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:15.926866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-877926cb-8e06-48c9-8f37-8adc52fe4f56 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "DELETE /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 404 len: 111 microversion: 2.1 time: 0.033292 Sep 13 15:39:15.926866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 684/877] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:39:15 2022] DELETE /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:39:15.931885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:15.932476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] [instance: 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:15.938835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:15.939952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:15.940847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:15.941908 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:15.942677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:15.943157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:15.959718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] HTTP exception thrown: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Request method failure captured: Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae HTTP/1.1 Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKH5_I4ESPV3QyR1qaywLY2z-bpxdrHfRhQH_ZQvE6iUkGbwuBd1SQBXLBatRUFQrnfDELM7MxSRp63__Hsfq2Wdb9tFef15S6d5NYavEJrowXg44Au_DjF6TWB1MIgCliO1vBC-no6JBHJL7SPa25uCkSGIRBo_HAD2FjYjxJGixH8 Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:15.961251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/597b9e023e324874ac5f24ee571d1f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/597b9e023e324874ac5f24ee571d1f66"}]}] Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 597b9e023e324874ac5f24ee571d1f66 Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-226066827 Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: c02aec8271af4bf7aea728ff92fa555b Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-226066827-project Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.962865 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '05da62b3-a8ec-4148-b17b-2c08f0e0d2ae'} Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:15.967388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. Sep 13 15:39:15.969235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:15.970587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] Returning 404 to user: Instance 05da62b3-a8ec-4148-b17b-2c08f0e0d2ae could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:15.970587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cd87777b-7e79-46db-998d-ccf5df2fb566 tempest-AttachVolumeTestJSON-226066827 tempest-AttachVolumeTestJSON-226066827-project] 10.222.0.16 "GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae" status: 404 len: 111 microversion: 2.1 time: 0.034350 Sep 13 15:39:15.970587 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 685/878] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:15 2022] GET /compute/v2.1/servers/05da62b3-a8ec-4148-b17b-2c08f0e0d2ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:39:29.473654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1593334928", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1900090519", "security_groups": [{"name": "tempest-secgroup-smoke-1261582798"}], "networks": [{"uuid": "2139647d-b8ca-48a5-8bc6-2c73cabd38be"}], "block_device_mapping_v2": [{"uuid": "655474dd-3a26-467f-a888-1c011600b4a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:29.484388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:29.485910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:29.486592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:29.604475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] validate_networks() for [('2139647d-b8ca-48a5-8bc6-2c73cabd38be', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:39:29.990803 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:39:29.991380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:39:29.992086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:39:29.992731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:39:29.993824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:39:30.004765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:30.005245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:30.005670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:30.006445 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:30.006887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:30.007301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:30.024541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Getting quotas for project 7eb316ace93e48c68ade74e9c5fccbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:39:30.028701 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Getting quotas for user cb98650b97664e0cbac0f574163b8c40 and project 7eb316ace93e48c68ade74e9c5fccbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:39:30.088651 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:39:30.090875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='655474dd-3a26-467f-a888-1c011600b4a0',volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:39:30.232888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f5e72ef3-149f-4848-9d21-01c86d8e6d71 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763184 Sep 13 15:39:30.233535 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 686/879] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:39:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 15:39:30.244497 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c8c935a8-fb4b-4b31-b41a-b931c8170c55 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:30.245070 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c8c935a8-fb4b-4b31-b41a-b931c8170c55 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:30.298869 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c8c935a8-fb4b-4b31-b41a-b931c8170c55 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:30.306611 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c8c935a8-fb4b-4b31-b41a-b931c8170c55 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1089 microversion: 2.1 time: 0.065786 Sep 13 15:39:30.307182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 687/880] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:30 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:31.329576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:31.330265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:31.337030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:31.337520 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:31.337968 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:31.338689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:31.339144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:31.339684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:31.428492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:31.436420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-751910c8-cf26-4edf-aa13-c160a79bf54b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1195 microversion: 2.1 time: 0.110896 Sep 13 15:39:31.437083 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 688/881] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:31 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1195 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:32.461429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:32.462193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:32.469113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:32.469638 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:32.470073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:32.470777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:32.471434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:32.471839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:32.823239 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:32.831707 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-48d26a77-45c0-4756-817f-5c35fbb01b08 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.374550 Sep 13 15:39:32.832394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 689/882] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:32 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:39:33.184735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-afad1f48-c3a7-4f05-b0a0-ae04c425a28b req-24f91cc6-fb9d-4061-8577-0f215612ee94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08572039-a710-40e6-bb3c-6fccc6fe5b41", "tag": "8e967886-3ff8-4d58-9c31-aca6431f68e2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:33.196045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-afad1f48-c3a7-4f05-b0a0-ae04c425a28b req-24f91cc6-fb9d-4061-8577-0f215612ee94 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:33.196528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-afad1f48-c3a7-4f05-b0a0-ae04c425a28b req-24f91cc6-fb9d-4061-8577-0f215612ee94 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:33.196978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-afad1f48-c3a7-4f05-b0a0-ae04c425a28b req-24f91cc6-fb9d-4061-8577-0f215612ee94 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:33.209261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-afad1f48-c3a7-4f05-b0a0-ae04c425a28b req-24f91cc6-fb9d-4061-8577-0f215612ee94 service nova] Creating event network-changed:8e967886-3ff8-4d58-9c31-aca6431f68e2 for instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 on hv-cinder-85743 Sep 13 15:39:33.214554 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-afad1f48-c3a7-4f05-b0a0-ae04c425a28b req-24f91cc6-fb9d-4061-8577-0f215612ee94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033691 Sep 13 15:39:33.215301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 690/883] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:33.861161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:33.862263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:33.873072 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:33.873881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:33.874669 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:33.875822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:33.876591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:33.877310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:34.025671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:34.033999 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8f080d20-ccfa-4273-afd9-74cbe9b51cdf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.180994 Sep 13 15:39:34.034607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 691/884] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:33 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:35.057477 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:35.058320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:35.065098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:35.065521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:35.065953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:35.066724 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:35.067174 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:35.067597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:35.211613 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:35.223923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4c9e415d-f945-4c8a-99d8-aefd53990022 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.170377 Sep 13 15:39:35.225590 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 692/885] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:35 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:36.248947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:36.249693 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:36.256332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:36.256815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:36.257241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:36.257927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:36.258400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:36.258822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:36.396316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:36.404133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ee5fa9c1-4f53-4aaa-a96a-d6ffc6721d13 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.159207 Sep 13 15:39:36.404694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 693/886] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:36 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:37.429926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:37.430556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:37.437047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:37.437544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:37.437943 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:37.438694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:37.439142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:37.439564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:37.580876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:37.588842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5c2516cd-8e01-430d-8cd1-75081b839210 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.164502 Sep 13 15:39:37.589431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 694/887] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:37 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:38.612007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:38.612818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:38.620568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:38.621073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:38.621502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:38.622229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:38.622680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:38.623278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:38.758805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:38.766534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c7baf32f-54e4-4e0d-b70a-391e5e9cd38a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.158530 Sep 13 15:39:38.767109 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 695/888] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:38 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:39:39.790426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:39.791082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:39.797644 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:39.798138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:39.798609 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:39.799282 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:39.799727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:39.800139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:39.937516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:39.945491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1210dd0c-2502-48de-b9c0-c2c05febea2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.159294 Sep 13 15:39:39.946039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 696/889] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:39 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:39:40.972974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:40.974044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:40.978144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:40.979306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=8 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:40.991230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:40.991868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:40.992391 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:40.993088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:40.993542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:40.994034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:41.137241 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:41.148987 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bbb62968-d8a5-43fd-9dc1-c4dc847debcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.182582 Sep 13 15:39:41.149540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 697/890] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:40 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:42.172352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:42.173097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:42.181596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:42.182261 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:42.182825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:42.183888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:42.184589 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:42.185194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:42.322131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:42.330451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6fa4db43-2f84-4a27-991d-a4869b1a1b0b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.163270 Sep 13 15:39:42.330957 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 698/891] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:42 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:43.354957 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:43.355652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:43.365607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:43.366126 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:43.366737 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:43.367597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:43.368281 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:43.368939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:43.530092 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:43.539856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ab109cd3-ce43-464d-92f1-db1182f14930 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.189941 Sep 13 15:39:43.540570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 699/892] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:43 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:44.117812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-506d53ea-6dbd-49d0-a223-aa1f640ed2b6 req-2db6181e-8479-490d-b26c-5ac55e3a208c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08572039-a710-40e6-bb3c-6fccc6fe5b41", "name": "network-vif-plugged", "status": "completed", "tag": "8e967886-3ff8-4d58-9c31-aca6431f68e2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:44.127870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-506d53ea-6dbd-49d0-a223-aa1f640ed2b6 req-2db6181e-8479-490d-b26c-5ac55e3a208c service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:44.128333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-506d53ea-6dbd-49d0-a223-aa1f640ed2b6 req-2db6181e-8479-490d-b26c-5ac55e3a208c service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:44.129071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-506d53ea-6dbd-49d0-a223-aa1f640ed2b6 req-2db6181e-8479-490d-b26c-5ac55e3a208c service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:44.143133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-506d53ea-6dbd-49d0-a223-aa1f640ed2b6 req-2db6181e-8479-490d-b26c-5ac55e3a208c service nova] Creating event network-vif-plugged:8e967886-3ff8-4d58-9c31-aca6431f68e2 for instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 on hv-cinder-85743 Sep 13 15:39:44.148205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-506d53ea-6dbd-49d0-a223-aa1f640ed2b6 req-2db6181e-8479-490d-b26c-5ac55e3a208c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 Sep 13 15:39:44.148810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 700/893] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:39:44.569901 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:44.571015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:44.582426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:44.583274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:44.584087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:44.585257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:44.586018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:44.586967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:44.731161 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:44.738948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-289647b0-0480-415d-a0b2-1c2cfd8f8b15 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.177277 Sep 13 15:39:44.739515 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 701/894] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:44 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:45.766155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:45.767205 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:45.778466 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:45.779170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:45.779880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:45.781013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:45.781779 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:45.782817 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:45.926295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:45.935908 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0a0bc25c-dfb5-4605-a209-001cb956a8ca tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.176424 Sep 13 15:39:45.936516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 702/895] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:45 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:46.964026 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:46.964748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:46.972065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:46.972597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:46.973068 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:46.973829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:46.974376 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:46.974842 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:47.110340 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:47.117932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-24fa4c42-ceeb-4da7-af71-6efaa0b4e4bb tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.161023 Sep 13 15:39:47.118528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 703/896] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:46 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:48.141076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:48.141826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:48.148888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:48.149380 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:48.149815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:48.150857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:48.151318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:48.151763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:48.290738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:48.298381 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-797b285b-9702-41b9-b389-7f116bc79988 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.161237 Sep 13 15:39:48.298959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 704/897] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:48 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:49.324112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:49.324851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:49.331552 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:49.332732 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:49.333172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:49.333879 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:49.334363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:49.334783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:49.353037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:39:49.471066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:49.479704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fc004a28-3e2a-4bbd-bd41-52d996f672e6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1261 microversion: 2.1 time: 0.159914 Sep 13 15:39:49.480286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 705/898] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:49 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:39:50.503827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:50.504615 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:50.513026 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.513628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.514280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.515208 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.515736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.516370 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.665149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:50.673267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a9f4c5f8-31c7-42bb-93d3-eb0f2b1e8b44 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1445 microversion: 2.1 time: 0.174192 Sep 13 15:39:50.673833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 706/899] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:50 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:50.681464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:50.683706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:50.689722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.690244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.690703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.691397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.691826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.692266 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.723221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3fce64fd-b754-43ed-b833-e1e788c666e2 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048297 Sep 13 15:39:50.723978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 707/900] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Sep 13 15:39:50 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:50.731132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:50.731733 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:50.737473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.737947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.738406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.739085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.739526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.739937 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.886755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:50.894861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-175fb19a-3dfb-49f1-a137-fcb30b486a89 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1445 microversion: 2.1 time: 0.167705 Sep 13 15:39:50.895556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 708/901] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:39:50 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1445 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:39:50.907078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:50.907581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:50.914133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.914639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.915077 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.915782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:50.916337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:50.916754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:50.943710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:39:51.027180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-03a6bc7f-483f-49e7-a17a-d6888635ec47 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 204 len: 0 microversion: 2.20 time: 0.129939 Sep 13 15:39:51.027810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 709/902] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 13 15:39:50 2022] DELETE /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 15:39:51.036830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:51.037522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:51.043856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:51.044591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:51.045033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:51.046119 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:51.046890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:51.047323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:51.192897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:51.202131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:51.203598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:51.204811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bb4d2e03-e65d-4461-a854-cd9b060e6ced tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.172349 Sep 13 15:39:51.205591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 710/903] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:39:51 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:39:52.231316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:52.232062 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:52.238427 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:52.238898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:52.239333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:52.240051 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:52.240504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:52.241035 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:52.388187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:52.396979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:52.398822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:52.400286 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4b68b07b-e46b-4d7a-94c2-991e4a97770b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1723 microversion: 2.20 time: 0.173486 Sep 13 15:39:52.401454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 711/904] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:39:52 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 15:39:52.749474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-95a9c788-404e-4ec5-ab4a-83aaec287ff6 req-94928302-aad5-4755-94f9-182e83414b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08572039-a710-40e6-bb3c-6fccc6fe5b41", "tag": "8e967886-3ff8-4d58-9c31-aca6431f68e2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:52.759246 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-95a9c788-404e-4ec5-ab4a-83aaec287ff6 req-94928302-aad5-4755-94f9-182e83414b15 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:52.759729 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-95a9c788-404e-4ec5-ab4a-83aaec287ff6 req-94928302-aad5-4755-94f9-182e83414b15 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:52.760154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-95a9c788-404e-4ec5-ab4a-83aaec287ff6 req-94928302-aad5-4755-94f9-182e83414b15 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:52.772005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-95a9c788-404e-4ec5-ab4a-83aaec287ff6 req-94928302-aad5-4755-94f9-182e83414b15 service nova] Creating event network-changed:8e967886-3ff8-4d58-9c31-aca6431f68e2 for instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 on hv-cinder-85743 Sep 13 15:39:52.777110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-95a9c788-404e-4ec5-ab4a-83aaec287ff6 req-94928302-aad5-4755-94f9-182e83414b15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Sep 13 15:39:52.778934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 712/905] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:39:53.429713 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:53.431265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:53.440287 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:53.441028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:53.441663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:53.442630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:53.443234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:53.443861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:53.529761 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:53.542472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:53.543927 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515e0f8a3a234deba5f909271b303abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cbf0c034dd54a8d856d9bc6fb485b45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:39:53.545115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8251ca4b-9ab6-4a21-b219-17d08d935aca tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 200 len: 1656 microversion: 2.20 time: 0.121714 Sep 13 15:39:53.545753 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 713/906] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:39:53 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 1656 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 15:39:53.871435 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-0d997f88-a7e6-4cb4-9d54-b609ed98c5db req-6ea28130-fedb-434a-bdee-a5f8302d955d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca18ccd-bba6-4f59-ac3a-61e4524607f0", "name": "network-vif-deleted", "tag": "5a5700cd-ed56-489f-9724-206efe586022"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:39:53.920262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-0d997f88-a7e6-4cb4-9d54-b609ed98c5db req-6ea28130-fedb-434a-bdee-a5f8302d955d service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:53.921057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-0d997f88-a7e6-4cb4-9d54-b609ed98c5db req-6ea28130-fedb-434a-bdee-a5f8302d955d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:53.921663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-0d997f88-a7e6-4cb4-9d54-b609ed98c5db req-6ea28130-fedb-434a-bdee-a5f8302d955d service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:53.949038 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-0d997f88-a7e6-4cb4-9d54-b609ed98c5db req-6ea28130-fedb-434a-bdee-a5f8302d955d service nova] Creating event network-vif-deleted:5a5700cd-ed56-489f-9724-206efe586022 for instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 on hv-cinder-85743 Sep 13 15:39:53.960468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-0d997f88-a7e6-4cb4-9d54-b609ed98c5db req-6ea28130-fedb-434a-bdee-a5f8302d955d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095677 Sep 13 15:39:53.965424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 714/907] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:39:54.572099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:54.574948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:54.583248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:54.583829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:54.584345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:54.585271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:54.585908 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:54.586562 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:54.601325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] HTTP exception thrown: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Request method failure captured: Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 HTTP/1.1 Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDXvXGOUw2ns5FLwVJB2FAPvBHVwq_1JlHsSi7AVAZKhzUu7763YnAb_HYxZBy65-Zqk0GX0-3_YVg0AUVn0YXCMZsmTRR2WwKQUgAlsVKs8tVhEPFhT4snbuEwplXDAEB0iNQ-MmYcRW14LVzITf7rP0gFVPfKyxmnUX_Jkzs7tA Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:54.603358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}] Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 515e0f8a3a234deba5f909271b303abb Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:54.605660 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '5ca18ccd-bba6-4f59-ac3a-61e4524607f0'} Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:54.606883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:54.608191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:54.610533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Returning 404 to user: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:54.611623 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f853dc51-29fc-497f-8f29-0bc6f6226f58 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 404 len: 111 microversion: 2.20 time: 0.043876 Sep 13 15:39:54.612308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 715/908] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:39:54 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 15:39:54.621836 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e1b592b1-bb8d-4fd6-86c6-46392e42ba4c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '.version_select at 0x7f4bc2ea5670>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:54.650087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e1b592b1-bb8d-4fd6-86c6-46392e42ba4c tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-515779821" status: 204 len: 0 microversion: 2.20 time: 0.033251 Sep 13 15:39:54.650720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 716/909] 10.222.0.16 () {60 vars in 1259 bytes} [Tue Sep 13 15:39:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-515779821 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 15:39:56.491788 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:56.492456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:56.500471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:56.500959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:56.501400 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:56.502123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:56.502596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:56.503027 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:56.516501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] HTTP exception thrown: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Request method failure captured: Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 HTTP/1.1 Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDXvXGOUw2ns5FLwVJB2FAPvBHVwq_1JlHsSi7AVAZKhzUu7763YnAb_HYxZBy65-Zqk0GX0-3_YVg0AUVn0YXCMZsmTRR2WwKQUgAlsVKs8tVhEPFhT4snbuEwplXDAEB0iNQ-MmYcRW14LVzITf7rP0gFVPfKyxmnUX_Jkzs7tA Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:56.518085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}] Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 515e0f8a3a234deba5f909271b303abb Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.519524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '5ca18ccd-bba6-4f59-ac3a-61e4524607f0'} Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:56.520272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.521699 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.523252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Returning 404 to user: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:56.523252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0cf34745-8d6f-41d5-b519-02310123ea40 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 404 len: 111 microversion: 2.20 time: 0.032655 Sep 13 15:39:56.523252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 717/910] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 13 15:39:56 2022] DELETE /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 15:39:56.529272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:56.529878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 5ca18ccd-bba6-4f59-ac3a-61e4524607f0] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:56.536279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:56.536767 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:56.537202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:56.537905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:56.538399 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:56.538830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:56.552304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] HTTP exception thrown: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Request method failure captured: Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 HTTP/1.1 Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDXvXGOUw2ns5FLwVJB2FAPvBHVwq_1JlHsSi7AVAZKhzUu7763YnAb_HYxZBy65-Zqk0GX0-3_YVg0AUVn0YXCMZsmTRR2WwKQUgAlsVKs8tVhEPFhT4snbuEwplXDAEB0iNQ-MmYcRW14LVzITf7rP0gFVPfKyxmnUX_Jkzs7tA Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:56.553828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}] Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 515e0f8a3a234deba5f909271b303abb Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.555607 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '5ca18ccd-bba6-4f59-ac3a-61e4524607f0'} Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:56.556483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. Sep 13 15:39:56.558312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:56.559678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Returning 404 to user: Instance 5ca18ccd-bba6-4f59-ac3a-61e4524607f0 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:56.559678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-15a0abce-fea6-4aca-abd0-d5f5be035a1b tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0" status: 404 len: 111 microversion: 2.20 time: 0.029860 Sep 13 15:39:56.559678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 718/911] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:39:56 2022] GET /compute/v2.1/servers/5ca18ccd-bba6-4f59-ac3a-61e4524607f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 15:39:57.704602 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:57.705189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:57.712063 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:57.712539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:57.712963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:57.713646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:57.714093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:57.714540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:57.727946 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] HTTP exception thrown: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Request method failure captured: Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 HTTP/1.1 Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDXvXGOUw2ns5FLwVJB2FAPvBHVwq_1JlHsSi7AVAZKhzUu7763YnAb_HYxZBy65-Zqk0GX0-3_YVg0AUVn0YXCMZsmTRR2WwKQUgAlsVKs8tVhEPFhT4snbuEwplXDAEB0iNQ-MmYcRW14LVzITf7rP0gFVPfKyxmnUX_Jkzs7tA Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:57.729474 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}] Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 515e0f8a3a234deba5f909271b303abb Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.731294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '34b86fc1-70f9-4cbe-a998-ec6aef1ba750'} Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:57.732084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.733284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.735085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Returning 404 to user: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:57.735085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4290c263-5ae2-4642-83bb-bab59c37dac0 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 404 len: 111 microversion: 2.20 time: 0.030383 Sep 13 15:39:57.735085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 719/912] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Sep 13 15:39:57 2022] DELETE /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 15:39:57.738861 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:39:57.739449 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] [instance: 34b86fc1-70f9-4cbe-a998-ec6aef1ba750] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:39:57.745105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:57.745573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:57.746031 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:57.746860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:39:57.747347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:39:57.747763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:39:57.760681 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] HTTP exception thrown: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Request method failure captured: Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 HTTP/1.1 Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKIDXvXGOUw2ns5FLwVJB2FAPvBHVwq_1JlHsSi7AVAZKhzUu7763YnAb_HYxZBy65-Zqk0GX0-3_YVg0AUVn0YXCMZsmTRR2WwKQUgAlsVKs8tVhEPFhT4snbuEwplXDAEB0iNQ-MmYcRW14LVzITf7rP0gFVPfKyxmnUX_Jkzs7tA Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:39:57.762597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3cbf0c034dd54a8d856d9bc6fb485b45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3cbf0c034dd54a8d856d9bc6fb485b45"}]}] Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3cbf0c034dd54a8d856d9bc6fb485b45 Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206836006 Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 515e0f8a3a234deba5f909271b303abb Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206836006-project Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.764349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '34b86fc1-70f9-4cbe-a998-ec6aef1ba750'} Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:39:57.765308 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. Sep 13 15:39:57.766799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:39:57.768191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] Returning 404 to user: Instance 34b86fc1-70f9-4cbe-a998-ec6aef1ba750 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:39:57.768191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0ccd8484-5c63-4b52-a500-2c4c7e1ef4b6 tempest-AttachVolumeShelveTestJSON-1206836006 tempest-AttachVolumeShelveTestJSON-1206836006-project] 10.222.0.16 "GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750" status: 404 len: 111 microversion: 2.20 time: 0.028662 Sep 13 15:39:57.768191 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 720/913] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Sep 13 15:39:57 2022] GET /compute/v2.1/servers/34b86fc1-70f9-4cbe-a998-ec6aef1ba750 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 15:40:02.585634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfdc5991-ccd0-4a24-942c-e5c6c6a25507 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Action: 'create', calling method: .version_select at 0x7f4bc2e1fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1655071197"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:40:03.002825 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bfdc5991-ccd0-4a24-942c-e5c6c6a25507 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.539455 Sep 13 15:40:03.003442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 721/914] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Sep 13 15:40:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 541 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 13 15:40:03.017075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-389303c6-1813-4ad4-8367-fa4b2c03ae5c tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e0af70>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:03.068401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-389303c6-1813-4ad4-8367-fa4b2c03ae5c tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 200 len: 345 microversion: 2.1 time: 0.055570 Sep 13 15:40:03.069057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 722/915] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:03 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:40:04.089966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3368a53f-f3c0-43fa-9d2c-2b537516e7b1 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e20820>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:04.140393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3368a53f-f3c0-43fa-9d2c-2b537516e7b1 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 200 len: 345 microversion: 2.1 time: 0.058154 Sep 13 15:40:04.140958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 723/916] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:04 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:05.157591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-306acdcf-4e05-4f71-9c95-b7bb18c3e724 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bbf662940>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:05.207973 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-306acdcf-4e05-4f71-9c95-b7bb18c3e724 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 200 len: 345 microversion: 2.1 time: 0.056056 Sep 13 15:40:05.208559 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 724/917] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:05 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:06.227583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-88380974-0450-4035-9a22-5e06e324ea61 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e03430>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:06.282471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-88380974-0450-4035-9a22-5e06e324ea61 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 200 len: 345 microversion: 2.1 time: 0.062220 Sep 13 15:40:06.283047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 725/918] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:06 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:07.302757 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-77bf3374-b525-466b-9e6b-3fac4ee6f734 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2ea58b0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:07.359617 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-77bf3374-b525-466b-9e6b-3fac4ee6f734 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 200 len: 345 microversion: 2.1 time: 0.064978 Sep 13 15:40:07.360203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 726/919] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:07 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:08.373143 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:40:08.373800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:40:08.378224 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-45f92c2a-71ea-42ce-8c1a-9b8b03f9afe9 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e03550>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:08.431810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-45f92c2a-71ea-42ce-8c1a-9b8b03f9afe9 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 200 len: 346 microversion: 2.1 time: 0.059566 Sep 13 15:40:08.432396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 727/920] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:08 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:08.445795 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-69f270a4-65c2-4e35-8771-a05621935c6e tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Action: 'create', calling method: .version_select at 0x7f4bc2e1f700>, body: {"snapshot": {"volume_id": "61ee9a5e-455e-4a59-b186-44dca77b2247", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1778314806"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:40:08.615388 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-69f270a4-65c2-4e35-8771-a05621935c6e tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.173208 Sep 13 15:40:08.615979 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 728/921] 10.222.0.16 () {60 vars in 1162 bytes} [Tue Sep 13 15:40:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:08.627910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6f41f27b-438a-49d1-87bc-fc72d75a0154 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e20c10>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:08.661025 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6f41f27b-438a-49d1-87bc-fc72d75a0154 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.036981 Sep 13 15:40:08.661606 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 729/922] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:08 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:40:08.672455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-27f63b2d-eb1d-4b92-815e-fc45a060b927 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e0a4c0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:08.702949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-27f63b2d-eb1d-4b92-815e-fc45a060b927 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034017 Sep 13 15:40:08.703525 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 730/923] 10.222.0.16 () {58 vars in 1140 bytes} [Tue Sep 13 15:40:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:40:08.716463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-36a41b1e-1329-4199-a979-6e92d1f87646 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e03c10>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:08.746444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-36a41b1e-1329-4199-a979-6e92d1f87646 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.035299 Sep 13 15:40:08.747005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 731/924] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:08 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:09.763235 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4dbfd0ab-85ae-4c9a-9297-3517340bd7cd tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e20e50>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:09.797932 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4dbfd0ab-85ae-4c9a-9297-3517340bd7cd tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.041030 Sep 13 15:40:09.798528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 732/925] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:09 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:10.813916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-53724c11-e5b9-4cac-bb1b-86c369e2b594 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2ea5af0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:10.848750 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-53724c11-e5b9-4cac-bb1b-86c369e2b594 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.039929 Sep 13 15:40:10.849460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 733/926] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:10 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:11.867328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-129188e4-5730-411a-baed-07ddb9c89b02 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc03ac8b0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:11.904710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-129188e4-5730-411a-baed-07ddb9c89b02 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.044734 Sep 13 15:40:11.905294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 734/927] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:11 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:12.923495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1dfa6214-c24f-4cd3-ba45-01994f6e0cd0 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2db9790>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:12.959174 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1dfa6214-c24f-4cd3-ba45-01994f6e0cd0 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.043847 Sep 13 15:40:12.959741 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 735/928] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:12 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:12.961064 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:40:12.961555 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:40:13.976389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a5f847fa-6809-4420-bef7-b8bc1d10d7af tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e1fdc0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:14.008022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a5f847fa-6809-4420-bef7-b8bc1d10d7af tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 288 microversion: 2.1 time: 0.038773 Sep 13 15:40:14.008581 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 736/929] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:13 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:14.019619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-625f35be-66f0-4d01-a9a9-79ea1d6f5034 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e030d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:14.079546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-625f35be-66f0-4d01-a9a9-79ea1d6f5034 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 202 len: 0 microversion: 2.1 time: 0.063394 Sep 13 15:40:14.080113 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 737/930] 10.222.0.16 () {58 vars in 1254 bytes} [Tue Sep 13 15:40:14 2022] DELETE /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:40:14.088078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-51458450-036b-4e40-af01-6741e6a83601 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e20d30>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:14.118530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-51458450-036b-4e40-af01-6741e6a83601 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.033941 Sep 13 15:40:14.119093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 738/931] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:14 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:40:15.137094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2050b465-dd9f-4abd-aa12-7d3bc6edd89b tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bbf4c4dc0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:15.176044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2050b465-dd9f-4abd-aa12-7d3bc6edd89b tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.046060 Sep 13 15:40:15.176829 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 739/932] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:15 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:16.196951 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-94847ae4-48e5-4c85-921b-2b8c06a32de2 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2ea5dc0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:16.237344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-94847ae4-48e5-4c85-921b-2b8c06a32de2 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.047921 Sep 13 15:40:16.237916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 740/933] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:16 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:17.256296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e1668e0f-5925-4058-891e-aeadf20a0741 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2e20040>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:17.289992 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e1668e0f-5925-4058-891e-aeadf20a0741 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.041337 Sep 13 15:40:17.290641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 741/934] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:17 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:18.308353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d657f4c-e7bf-4022-a86e-57386fd3096a tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2ea5dc0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:18.339726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d657f4c-e7bf-4022-a86e-57386fd3096a tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 200 len: 287 microversion: 2.1 time: 0.038590 Sep 13 15:40:18.340299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 742/935] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:18 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:19.357709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b8edde5e-b24f-4ed9-9731-223bd3b5ae57 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bbf4c4dc0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:19.384255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-b8edde5e-b24f-4ed9-9731-223bd3b5ae57 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] HTTP exception thrown: Snapshot 3eb99235-ba33-4025-aee2-10c3824d62a2 could not be found. Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b8edde5e-b24f-4ed9-9731-223bd3b5ae57 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Request method failure captured: Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 HTTP/1.1 Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKRSQ6V72xCT9INZ6n3dJC0vr85Z-YSZ0XtJyuWyCYIa_VXZE-T9y5ahXR1c3_zUgqpSitPkG33pbDWaVSZ7RV7ZTPYu6rHx3x_M-bRVFoFt35znk-nj_rl_YPZSzcFMoorj6cxgHKJAAinrW49uUb_HQHZD1uYjegjrbk_e6gDMIJI Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:40:19.386665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}] Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: df66e899b9594487bef79b2fbc079bb8 Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Snapshot 3eb99235-ba33-4025-aee2-10c3824d62a2 could not be found. Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '3eb99235-ba33-4025-aee2-10c3824d62a2'} Sep 13 15:40:19.388347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3eb99235-ba33-4025-aee2-10c3824d62a2 could not be found. (HTTP 404) (Request-ID: req-a3d8517c-9272-4ee0-a3d9-4c2e23120c89) Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:19.389396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:40:19.390744 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3eb99235-ba33-4025-aee2-10c3824d62a2 could not be found. Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 15:40:19.391887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3eb99235-ba33-4025-aee2-10c3824d62a2 could not be found. Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3eb99235-ba33-4025-aee2-10c3824d62a2 could not be found. Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b8edde5e-b24f-4ed9-9731-223bd3b5ae57 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Returning 404 to user: Snapshot 3eb99235-ba33-4025-aee2-10c3824d62a2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b8edde5e-b24f-4ed9-9731-223bd3b5ae57 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2" status: 404 len: 111 microversion: 2.1 time: 0.037862 Sep 13 15:40:19.393277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 743/936] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Sep 13 15:40:19 2022] GET /compute/v2.1/os-snapshots/3eb99235-ba33-4025-aee2-10c3824d62a2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:40:19.398395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2305daa5-8590-422c-a5ba-7bff37017f69 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bbf6c6af0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:19.464253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2305daa5-8590-422c-a5ba-7bff37017f69 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 202 len: 0 microversion: 2.1 time: 0.070254 Sep 13 15:40:19.464824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 744/937] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:40:19 2022] DELETE /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:40:19.473665 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dec97a49-8005-47e3-8b7b-2b96834e5413 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bc2ea5c10>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:19.525575 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dec97a49-8005-47e3-8b7b-2b96834e5413 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 200 len: 345 microversion: 2.1 time: 0.055866 Sep 13 15:40:19.526159 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 745/938] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:19 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:20.541852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-50e0b815-dd29-4661-9444-8105813b6a13 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bbf504670>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:20.574649 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-50e0b815-dd29-4661-9444-8105813b6a13 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] HTTP exception thrown: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-50e0b815-dd29-4661-9444-8105813b6a13 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Request method failure captured: Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 HTTP/1.1 Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKRSQ6V72xCT9INZ6n3dJC0vr85Z-YSZ0XtJyuWyCYIa_VXZE-T9y5ahXR1c3_zUgqpSitPkG33pbDWaVSZ7RV7ZTPYu6rHx3x_M-bRVFoFt35znk-nj_rl_YPZSzcFMoorj6cxgHKJAAinrW49uUb_HQHZD1uYjegjrbk_e6gDMIJI Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:40:20.576603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}] Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: df66e899b9594487bef79b2fbc079bb8 Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '61ee9a5e-455e-4a59-b186-44dca77b2247'} Sep 13 15:40:20.578089 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. (HTTP 404) (Request-ID: req-0daa43a4-0599-4fa7-823c-6a2706126606) Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.579066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:40:20.580462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 15:40:20.581697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-50e0b815-dd29-4661-9444-8105813b6a13 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Returning 404 to user: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-50e0b815-dd29-4661-9444-8105813b6a13 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 404 len: 109 microversion: 2.1 time: 0.041961 Sep 13 15:40:20.583065 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 746/939] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:20 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:40:20.588486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5bb6409d-b830-4598-a9be-a5ad37f09116 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bbf4ed9d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:20.616215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-5bb6409d-b830-4598-a9be-a5ad37f09116 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] HTTP exception thrown: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5bb6409d-b830-4598-a9be-a5ad37f09116 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Request method failure captured: Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 HTTP/1.1 Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKRSQ6V72xCT9INZ6n3dJC0vr85Z-YSZ0XtJyuWyCYIa_VXZE-T9y5ahXR1c3_zUgqpSitPkG33pbDWaVSZ7RV7ZTPYu6rHx3x_M-bRVFoFt35znk-nj_rl_YPZSzcFMoorj6cxgHKJAAinrW49uUb_HQHZD1uYjegjrbk_e6gDMIJI Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:40:20.618135 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}] Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: df66e899b9594487bef79b2fbc079bb8 Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '61ee9a5e-455e-4a59-b186-44dca77b2247'} Sep 13 15:40:20.619678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. (HTTP 404) (Request-ID: req-3a1925b8-6120-4a02-a726-d3a4fab227fd) Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.620630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 15:40:20.622127 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 15:40:20.623422 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5bb6409d-b830-4598-a9be-a5ad37f09116 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Returning 404 to user: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5bb6409d-b830-4598-a9be-a5ad37f09116 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 404 len: 109 microversion: 2.1 time: 0.035256 Sep 13 15:40:20.625202 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 747/940] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:40:20 2022] DELETE /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:40:20.628509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5a617ebb-8d16-4297-a3a5-a13e14ea9543 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Calling method '.version_select at 0x7f4bbf504280>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:20.658256 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-5a617ebb-8d16-4297-a3a5-a13e14ea9543 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] HTTP exception thrown: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5a617ebb-8d16-4297-a3a5-a13e14ea9543 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Request method failure captured: Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 HTTP/1.1 Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKRSQ6V72xCT9INZ6n3dJC0vr85Z-YSZ0XtJyuWyCYIa_VXZE-T9y5ahXR1c3_zUgqpSitPkG33pbDWaVSZ7RV7ZTPYu6rHx3x_M-bRVFoFt35znk-nj_rl_YPZSzcFMoorj6cxgHKJAAinrW49uUb_HQHZD1uYjegjrbk_e6gDMIJI Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:40:20.660270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf9c6d4a95e549b1a1931e613b834afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf9c6d4a95e549b1a1931e613b834afc"}]}] Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: bf9c6d4a95e549b1a1931e613b834afc Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-188046772 Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: df66e899b9594487bef79b2fbc079bb8 Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-188046772-project Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '61ee9a5e-455e-4a59-b186-44dca77b2247'} Sep 13 15:40:20.661890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. (HTTP 404) (Request-ID: req-598b954e-dcbc-482d-8b4f-98d807713453) Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.662953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 15:40:20.664304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 15:40:20.665912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5a617ebb-8d16-4297-a3a5-a13e14ea9543 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] Returning 404 to user: Volume 61ee9a5e-455e-4a59-b186-44dca77b2247 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5a617ebb-8d16-4297-a3a5-a13e14ea9543 tempest-VolumesSnapshotsTestJSON-188046772 tempest-VolumesSnapshotsTestJSON-188046772-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247" status: 404 len: 109 microversion: 2.1 time: 0.037513 Sep 13 15:40:20.667324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 748/941] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:20 2022] GET /compute/v2.1/os-volumes/61ee9a5e-455e-4a59-b186-44dca77b2247 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:40:25.617101 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9c97691e-aac6-48e8-b0bf-49d40d4249e1 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc0d98a60>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:25.668377 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9c97691e-aac6-48e8-b0bf-49d40d4249e1 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/78543bd2-d550-4aca-9e4b-8e66294621a0" status: 200 len: 351 microversion: 2.1 time: 0.055662 Sep 13 15:40:25.668947 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 749/942] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:25 2022] GET /compute/v2.1/os-volumes/78543bd2-d550-4aca-9e4b-8e66294621a0 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:40:27.220430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a2d90ba3-7026-4b58-8d3e-50a5723aa75f tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2e5a0d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:27.268575 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a2d90ba3-7026-4b58-8d3e-50a5723aa75f tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/c8192819-9d4e-41eb-aed1-3d420d33988c" status: 200 len: 351 microversion: 2.1 time: 0.052524 Sep 13 15:40:27.269314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 750/943] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:27 2022] GET /compute/v2.1/os-volumes/c8192819-9d4e-41eb-aed1-3d420d33988c => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:32.885456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a66fea7d-e04a-4846-ba18-26f606cd5222 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2e03430>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:32.939893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a66fea7d-e04a-4846-ba18-26f606cd5222 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/857ef5e4-20cf-4e97-9f9e-7c8a14325a82" status: 200 len: 350 microversion: 2.1 time: 0.059069 Sep 13 15:40:32.940752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 751/944] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Sep 13 15:40:32 2022] GET /compute/v2.1/os-volumes/857ef5e4-20cf-4e97-9f9e-7c8a14325a82 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:32.954082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ad9cc2ba-5d8e-42ed-941b-bada8d702b69 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2e681f0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.034553 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ad9cc2ba-5d8e-42ed-941b-bada8d702b69 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083896 Sep 13 15:40:33.035123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 752/945] 10.222.0.16 () {58 vars in 1134 bytes} [Tue Sep 13 15:40:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:40:33.049464 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a8263ec-5727-4adf-9646-323ba01b9311 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2e4cc10>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.135022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a8263ec-5727-4adf-9646-323ba01b9311 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089042 Sep 13 15:40:33.135845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 753/946] 10.222.0.16 () {58 vars in 1149 bytes} [Tue Sep 13 15:40:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:40:33.150081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6edd0ca9-a961-4a8e-8bba-f8f0cc9a9c0e tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2e03a60>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.237106 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6edd0ca9-a961-4a8e-8bba-f8f0cc9a9c0e tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091546 Sep 13 15:40:33.237996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 754/947] 10.222.0.16 () {58 vars in 1134 bytes} [Tue Sep 13 15:40:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:40:33.251645 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-192e43c6-0867-4fdd-9c3e-f80d4253a4c7 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bbf4c4f70>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.342549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-192e43c6-0867-4fdd-9c3e-f80d4253a4c7 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094606 Sep 13 15:40:33.352200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 755/948] 10.222.0.16 () {58 vars in 1167 bytes} [Tue Sep 13 15:40:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:40:33.358302 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5b6e33b0-2a2f-495a-946f-b212cc215b55 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2e5a820>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.449210 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5b6e33b0-2a2f-495a-946f-b212cc215b55 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095196 Sep 13 15:40:33.450155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 756/949] 10.222.0.16 () {58 vars in 1170 bytes} [Tue Sep 13 15:40:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:33.464157 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6f5e8c2a-ab6a-4121-84dc-209baf8f84a6 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2dbeca0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.548151 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6f5e8c2a-ab6a-4121-84dc-209baf8f84a6 tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087730 Sep 13 15:40:33.548826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 757/950] 10.222.0.16 () {58 vars in 1155 bytes} [Tue Sep 13 15:40:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:40:33.562948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfa0ceb5-8117-45a6-a199-9931b470fbde tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2dbe4c0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.646492 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bfa0ceb5-8117-45a6-a199-9931b470fbde tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087665 Sep 13 15:40:33.647095 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 758/951] 10.222.0.16 () {58 vars in 1188 bytes} [Tue Sep 13 15:40:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:40:33.663451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5242df47-5c9d-4617-9a9b-7ad5d726764c tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] Calling method '.version_select at 0x7f4bc2e0a790>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:40:33.898716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5242df47-5c9d-4617-9a9b-7ad5d726764c tempest-VolumesTestJSON-1829737725 tempest-VolumesTestJSON-1829737725-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.238930 Sep 13 15:40:33.899285 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 759/952] 10.222.0.16 () {58 vars in 1155 bytes} [Tue Sep 13 15:40:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:41:00.388170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:00.388910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:00.395243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:00.395728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:00.396173 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:00.396859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:00.397325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:00.397742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:00.421345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-36812c43-fdf8-4221-b7d3-e917867c0f31 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/ips" status: 200 len: 151 microversion: 2.1 time: 0.038439 Sep 13 15:41:00.421915 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 760/953] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Sep 13 15:41:00 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:41:04.978211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26b5bd44-f053-4f2d-b5bf-e269981bbd33"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:41:04.981271 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:04.987853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:04.988336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:04.988769 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:04.989458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:04.989903 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:04.990368 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:05.268795 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4dee8a2a-556b-49c2-8d90-97c6f94154bd tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "POST /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294409 Sep 13 15:41:05.269721 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 761/954] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:41:04 2022] POST /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:41:12.983958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:12.984612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:12.994183 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:12.994677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:12.995133 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:12.996024 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:12.996471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:12.996925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:13.085274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lazy-loading 'services' on Instance uuid 100b4bbd-17e4-45ff-8606-e36f2eeda69d {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:41:13.162895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e7d25c93-71ae-4a49-bdf8-5afa8f216c57 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments/26b5bd44-f053-4f2d-b5bf-e269981bbd33" status: 202 len: 0 microversion: 2.1 time: 0.184250 Sep 13 15:41:13.163425 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 762/955] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:41:12 2022] DELETE /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments/26b5bd44-f053-4f2d-b5bf-e269981bbd33 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:41:13.172247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:13.174598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:13.181145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:13.181621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:13.182122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:13.182925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:13.183480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:13.183890 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:13.215988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-acbe127b-d3bb-4221-8846-7cc27880d35a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047945 Sep 13 15:41:13.216544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 763/956] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:41:13 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:41:14.230093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:14.232226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:14.239068 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:14.239720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:14.240088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:14.240782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:14.241230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:14.241646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:14.272075 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-21265fae-db91-450f-8c73-0cf6bd4eacfc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046194 Sep 13 15:41:14.272624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 764/957] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Sep 13 15:41:14 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 15:41:14.342841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:14.343363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:14.349898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:14.350413 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:14.350846 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:14.351530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:14.351976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:14.352396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:14.380798 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:41:14.464872 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-da72960e-6840-4563-9e21-6b522f4db861 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 204 len: 0 microversion: 2.1 time: 0.125247 Sep 13 15:41:14.465897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 765/958] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:41:14 2022] DELETE /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:41:14.483462 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:14.484358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:14.492236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:14.492716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:14.493153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:14.493844 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:14.494318 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:14.494774 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:14.644272 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:41:14.652882 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8ba2ab12-4583-4016-a868-af4aace869dc tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1681 microversion: 2.1 time: 0.179017 Sep 13 15:41:14.653438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 766/959] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:14 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:41:15.684458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:15.685128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:15.692461 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:15.693240 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:15.693722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:15.694652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:15.695327 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:15.695758 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:15.849534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:41:15.858521 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-84439c25-b4a8-4fdd-861b-138a3773429a tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1681 microversion: 2.1 time: 0.177851 Sep 13 15:41:15.859098 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 767/960] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:15 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:41:16.882407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:16.883116 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:16.889950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:16.890472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:16.890904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:16.891848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:16.892057 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:16.892480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:17.111934 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:41:17.119929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d7288a10-195b-4361-b562-e950b30daefb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1681 microversion: 2.1 time: 0.241928 Sep 13 15:41:17.120519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 768/961] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:16 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:41:18.008522 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-d832f47b-4bcc-4c7e-8087-86123fa8ee51 req-1e596a0c-edda-4b11-8d7a-33e8f014aa4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100b4bbd-17e4-45ff-8606-e36f2eeda69d", "name": "network-vif-deleted", "tag": "2d308a79-d4e3-4650-921d-5f3b094974f4"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:41:18.021073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d832f47b-4bcc-4c7e-8087-86123fa8ee51 req-1e596a0c-edda-4b11-8d7a-33e8f014aa4f service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:18.023215 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d832f47b-4bcc-4c7e-8087-86123fa8ee51 req-1e596a0c-edda-4b11-8d7a-33e8f014aa4f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:18.024526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d832f47b-4bcc-4c7e-8087-86123fa8ee51 req-1e596a0c-edda-4b11-8d7a-33e8f014aa4f service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:18.211458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-d832f47b-4bcc-4c7e-8087-86123fa8ee51 req-1e596a0c-edda-4b11-8d7a-33e8f014aa4f service nova] Creating event network-vif-deleted:2d308a79-d4e3-4650-921d-5f3b094974f4 for instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d on hv-cinder-85743 Sep 13 15:41:18.216810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-d832f47b-4bcc-4c7e-8087-86123fa8ee51 req-1e596a0c-edda-4b11-8d7a-33e8f014aa4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.446876 Sep 13 15:41:18.217419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 769/962] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:41:18.222498 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:18.223189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:18.229853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:18.230372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:18.230802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:18.231494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:18.231941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:18.232355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:18.277236 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:18.277656 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:18.278079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:18.278570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lazy-loading 'fault' on Instance uuid 100b4bbd-17e4-45ff-8606-e36f2eeda69d {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:41:18.345255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48ce3ac32e741ef98e5025fd23bbaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76163bf55e0a403aaec08c9c6a68a55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:41:18.357166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-167b623d-9508-40ab-a192-6ba198412ecb tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 200 len: 1330 microversion: 2.1 time: 0.138580 Sep 13 15:41:18.358259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 770/963] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:18 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:41:19.382785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:19.384326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:19.391598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:19.392706 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:19.393148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:19.393857 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:19.394344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:19.394752 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:19.409239 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d HTTP/1.1 Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:19.410942 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:19.412878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '100b4bbd-17e4-45ff-8606-e36f2eeda69d'} Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:19.413727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:19.415280 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:19.416718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:19.416718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c43a3ed4-c633-4de7-b4d6-44436ce81962 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 404 len: 111 microversion: 2.1 time: 0.034646 Sep 13 15:41:19.416718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 771/964] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:19 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:41:19.421447 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-547b9a85-a0da-45ad-8c5f-a4c27d49f0a8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '.version_select at 0x7f4bbf6c6c10>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:19.449504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-547b9a85-a0da-45ad-8c5f-a4c27d49f0a8 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852772945" status: 202 len: 0 microversion: 2.1 time: 0.031623 Sep 13 15:41:19.450049 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 772/965] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Sep 13 15:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852772945 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:41:21.239619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:21.240242 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:21.247566 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:21.248087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:21.249792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:21.250567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:21.251046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:21.251465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:21.265406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d HTTP/1.1 Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:21.267018 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.268485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '100b4bbd-17e4-45ff-8606-e36f2eeda69d'} Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:21.269401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.271061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.273084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:21.273084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-322f2f4d-20db-4b21-a5af-2d4089f5c1e0 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 404 len: 111 microversion: 2.1 time: 0.033295 Sep 13 15:41:21.273084 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 773/966] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:41:21 2022] DELETE /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:41:21.276851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:21.277455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 100b4bbd-17e4-45ff-8606-e36f2eeda69d] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:21.283426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:21.283904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:21.284329 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:21.285011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:21.285455 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:21.285868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:21.299200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d HTTP/1.1 Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:21.300704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.302372 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '100b4bbd-17e4-45ff-8606-e36f2eeda69d'} Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:21.303529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. Sep 13 15:41:21.305003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:21.306689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 100b4bbd-17e4-45ff-8606-e36f2eeda69d could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:21.306689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-df07a499-6960-45a5-adaf-fd2f7afb28cf tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d" status: 404 len: 111 microversion: 2.1 time: 0.028836 Sep 13 15:41:21.306689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 774/967] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:21 2022] GET /compute/v2.1/servers/100b4bbd-17e4-45ff-8606-e36f2eeda69d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:41:22.447722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:22.448379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:22.454764 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.455253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.455736 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.456430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.457216 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.457650 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.471433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 HTTP/1.1 Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:22.473015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.474725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '30d53a86-9ab1-43c5-a755-d1ccb689be99'} Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:22.475718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.477305 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.478813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:22.478813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-27170456-a68e-4996-b197-f32b673d5c81 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 404 len: 111 microversion: 2.1 time: 0.030812 Sep 13 15:41:22.478813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 775/968] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:41:22 2022] DELETE /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:41:22.483187 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:22.483805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 30d53a86-9ab1-43c5-a755-d1ccb689be99] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:22.489511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.490302 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.490460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.491145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.491727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.492129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.505516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 HTTP/1.1 Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:22.507132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.508663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '30d53a86-9ab1-43c5-a755-d1ccb689be99'} Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:22.509452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. Sep 13 15:41:22.510728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.511848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 30d53a86-9ab1-43c5-a755-d1ccb689be99 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:22.511848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eadceeed-bed3-4a65-be74-cede47718c22 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99" status: 404 len: 111 microversion: 2.1 time: 0.028989 Sep 13 15:41:22.511848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 776/969] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:22 2022] GET /compute/v2.1/servers/30d53a86-9ab1-43c5-a755-d1ccb689be99 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:41:22.516838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:22.517289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:22.523100 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.523583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.524020 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.524715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.525168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.525595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.538972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 HTTP/1.1 Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:22.540509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.542226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': 'fef3959b-a730-4f58-95ac-f15f415f8217'} Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:22.543369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.544833 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.546710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:22.546710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-06ad3de4-7522-4a33-aee8-61f1d37f8a95 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 404 len: 111 microversion: 2.1 time: 0.028671 Sep 13 15:41:22.546710 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 777/970] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:41:22 2022] DELETE /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:41:22.550342 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:22.550952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: fef3959b-a730-4f58-95ac-f15f415f8217] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:22.556814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.557277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.557701 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.558431 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:22.558888 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:22.559714 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:22.572893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 HTTP/1.1 Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:22.574485 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.575859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': 'fef3959b-a730-4f58-95ac-f15f415f8217'} Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:22.576671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. Sep 13 15:41:22.577910 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:22.579081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance fef3959b-a730-4f58-95ac-f15f415f8217 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:22.579081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e7466e76-beec-4bfe-94b9-5c39fae53005 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217" status: 404 len: 111 microversion: 2.1 time: 0.029118 Sep 13 15:41:22.579081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 778/971] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:22 2022] GET /compute/v2.1/servers/fef3959b-a730-4f58-95ac-f15f415f8217 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:41:23.733252 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:23.733860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:23.740715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:23.741194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:23.741626 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:23.742353 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:23.742855 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:23.743310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:23.747392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:41:23.757818 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 HTTP/1.1 Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:23.759690 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.761453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '2ec25cef-3608-4af4-a0ff-119c601b2cb2'} Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:23.762659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.764129 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.765964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:23.765964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-558bbdad-7bbd-4861-92b4-f70aff9db192 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 404 len: 111 microversion: 2.1 time: 0.031790 Sep 13 15:41:23.765964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 779/972] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:41:23 2022] DELETE /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:41:23.769199 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:41:23.769807 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] [instance: 2ec25cef-3608-4af4-a0ff-119c601b2cb2] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:41:23.776843 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:23.777326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:23.777728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:23.778442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:41:23.778891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:41:23.779309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:41:23.793735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] HTTP exception thrown: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Request method failure captured: Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 HTTP/1.1 Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKJrEL6nPcdOyX47Wy2s1ji0PGNf5fSzrBJEY_SZQ1CguezaEaMLCNiWEYQdwXP2lBh_E1jF-rgi-b22U_W0VpN-ppuYl2Kf1g23lYe3alKwGVHopsikIcNwgcPmIhfK2mFBKTl8yYaJKJ_8qrF1BfCKqGKOIVASWU6oIwrCHucLjsI Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:41:23.795268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76163bf55e0a403aaec08c9c6a68a55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76163bf55e0a403aaec08c9c6a68a55f"}]}] Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 76163bf55e0a403aaec08c9c6a68a55f Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1593388853 Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: f48ce3ac32e741ef98e5025fd23bbaa0 Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1593388853-project Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.796782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '2ec25cef-3608-4af4-a0ff-119c601b2cb2'} Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:41:23.797574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. Sep 13 15:41:23.799078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:41:23.800458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] Returning 404 to user: Instance 2ec25cef-3608-4af4-a0ff-119c601b2cb2 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:41:23.800458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c235bfaa-0da6-4e0b-a4a8-1ecb03e921b5 tempest-AttachVolumeNegativeTest-1593388853 tempest-AttachVolumeNegativeTest-1593388853-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2" status: 404 len: 111 microversion: 2.1 time: 0.031071 Sep 13 15:41:23.800458 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 780/973] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:41:23 2022] GET /compute/v2.1/servers/2ec25cef-3608-4af4-a0ff-119c601b2cb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:41:49.647247 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:41:49.647692 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:41:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:42:01.941030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-798482421", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "networks": [{"uuid": "cf36cbce-2ddc-4193-922d-7c2bf739a4cd"}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:42:01.952534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:01.953188 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:02.002909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] validate_networks() for [('cf36cbce-2ddc-4193-922d-7c2bf739a4cd', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:42:02.432487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:42:02.433041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:42:02.433840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:42:02.434504 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:42:02.435142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:42:02.446716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:02.447359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:02.447847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:02.448847 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:02.449304 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:02.449726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:02.467366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Getting quotas for project cb52082b3d6d4b4aab5cc9b9c2e86cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:42:02.471809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Getting quotas for user 2b9bd416dc3447509ab5451d2c0b479f and project cb52082b3d6d4b4aab5cc9b9c2e86cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:42:02.483997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:42:02.486385 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:42:02.533362 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0730ff61-3983-433d-a750-3298a02d9448 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597921 Sep 13 15:42:02.534173 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 781/974] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:42:02.545740 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-195cf8bc-bb45-47e1-a4df-7eea9156c8a2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:02.546378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-195cf8bc-bb45-47e1-a4df-7eea9156c8a2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:02.600145 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-195cf8bc-bb45-47e1-a4df-7eea9156c8a2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:02.607297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-195cf8bc-bb45-47e1-a4df-7eea9156c8a2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1218 microversion: 2.1 time: 0.065670 Sep 13 15:42:02.608071 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 782/975] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:02 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:03.635549 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:03.636852 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:03.646270 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:03.647023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:03.647636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:03.648631 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:03.649976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:03.649976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:03.721478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:03.730405 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-508f82cd-cb97-47ce-9a06-a01ea293efac tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1270 microversion: 2.1 time: 0.102634 Sep 13 15:42:03.739079 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 783/976] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:03 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:04.755206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:04.755911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:04.763393 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:04.763925 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:04.764364 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:04.765078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:04.765537 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:04.765972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:04.987783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:04.995754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cd59d5b5-9c9d-41da-b86e-798642d98c05 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1318 microversion: 2.1 time: 0.244717 Sep 13 15:42:04.996371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 784/977] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:04 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:05.200612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-3eddb2c5-5937-44d2-ae86-72d61911d2fb req-37507488-f04e-4dd7-ba3b-ae4d241f98ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43addaa8-29a2-43dc-9f36-e315c06fa218", "tag": "7e483d59-431a-4d8a-9a46-cac69ee3d82b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:42:05.212420 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3eddb2c5-5937-44d2-ae86-72d61911d2fb req-37507488-f04e-4dd7-ba3b-ae4d241f98ab service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:05.212901 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3eddb2c5-5937-44d2-ae86-72d61911d2fb req-37507488-f04e-4dd7-ba3b-ae4d241f98ab service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:05.213334 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3eddb2c5-5937-44d2-ae86-72d61911d2fb req-37507488-f04e-4dd7-ba3b-ae4d241f98ab service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:05.225998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-3eddb2c5-5937-44d2-ae86-72d61911d2fb req-37507488-f04e-4dd7-ba3b-ae4d241f98ab service nova] Creating event network-changed:7e483d59-431a-4d8a-9a46-cac69ee3d82b for instance 43addaa8-29a2-43dc-9f36-e315c06fa218 on hv-cinder-85743 Sep 13 15:42:05.231805 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-3eddb2c5-5937-44d2-ae86-72d61911d2fb req-37507488-f04e-4dd7-ba3b-ae4d241f98ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035726 Sep 13 15:42:05.232415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 785/978] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:42:06.025153 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:06.026371 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:06.033604 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:06.034085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:06.034545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:06.035231 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:06.035676 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:06.036093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:06.180664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:06.188886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c9e76ab7-efc3-4cd8-beb5-bf4fbc495f51 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1318 microversion: 2.1 time: 0.172020 Sep 13 15:42:06.189449 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 786/979] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:06 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:07.220793 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:07.221827 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:07.231765 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:07.232249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:07.232670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:07.233357 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:07.233802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:07.234251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:07.373471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:07.381480 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-76be0446-d90a-4791-afc2-b57f09d31738 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1318 microversion: 2.1 time: 0.167664 Sep 13 15:42:07.382011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 787/980] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:07 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:08.404812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:08.405550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:08.412217 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:08.412703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:08.413141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:08.413841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:08.414332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:08.414758 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:08.640712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:08.652698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6533899d-7b01-4ba1-913f-18605a08ac78 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1318 microversion: 2.1 time: 0.251832 Sep 13 15:42:08.653839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 788/981] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:08 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:09.679263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:09.679898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:09.688424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:09.688909 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:09.689348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:09.690036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:09.690523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:09.690944 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:09.836743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:09.845483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b999d1b9-fca9-4f63-8db4-cdac012388a1 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1318 microversion: 2.1 time: 0.172634 Sep 13 15:42:09.846028 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 789/982] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:09 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:10.837268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-8cc98b94-09be-4056-a7cd-ed648fbeecce req-e69a4bed-0c2f-45ed-8f67-0cc5663f09c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43addaa8-29a2-43dc-9f36-e315c06fa218", "name": "network-vif-plugged", "status": "completed", "tag": "7e483d59-431a-4d8a-9a46-cac69ee3d82b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:42:10.847315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8cc98b94-09be-4056-a7cd-ed648fbeecce req-e69a4bed-0c2f-45ed-8f67-0cc5663f09c7 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:10.847718 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8cc98b94-09be-4056-a7cd-ed648fbeecce req-e69a4bed-0c2f-45ed-8f67-0cc5663f09c7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:10.848144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8cc98b94-09be-4056-a7cd-ed648fbeecce req-e69a4bed-0c2f-45ed-8f67-0cc5663f09c7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:10.858971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-8cc98b94-09be-4056-a7cd-ed648fbeecce req-e69a4bed-0c2f-45ed-8f67-0cc5663f09c7 service nova] Creating event network-vif-plugged:7e483d59-431a-4d8a-9a46-cac69ee3d82b for instance 43addaa8-29a2-43dc-9f36-e315c06fa218 on hv-cinder-85743 Sep 13 15:42:10.863845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-8cc98b94-09be-4056-a7cd-ed648fbeecce req-e69a4bed-0c2f-45ed-8f67-0cc5663f09c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157514 Sep 13 15:42:10.864403 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 790/983] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:42:10.875997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:10.876684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:10.883332 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:10.883579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:10.883839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:10.884525 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:10.884974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:10.885389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:11.058248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:11.066128 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7983bab7-03ec-4b64-8622-65ed464d522e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1318 microversion: 2.1 time: 0.194009 Sep 13 15:42:11.066731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 791/984] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:10 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:42:12.092926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:12.093678 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:12.100823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:12.101339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:12.101790 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:12.102564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:12.103041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:12.103490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:12.238397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:12.251144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fd753ca2-fc4a-4180-a2d0-17ff2607d9cc tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1318 microversion: 2.1 time: 0.164021 Sep 13 15:42:12.251953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 792/985] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:12 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:12.741268 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:42:12.741870 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:42:13.278622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:13.279391 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:13.281442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:13.282131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=8 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:13.288278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:13.288766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:13.289204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:13.290033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:13.290578 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:13.290821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:13.427646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:13.438514 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7763f20a-5099-40a5-86c7-f7ffe8a5a523 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1507 microversion: 2.1 time: 0.166553 Sep 13 15:42:13.439056 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 793/986] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:13 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:34.061935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e7b7c29-1f1d-4b97-be68-b770dd665491", "device": "/dev/sdb"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:42:34.064957 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:34.067511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:34.068278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=60 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:34.074358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:34.074830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:34.075267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:34.075961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:34.076491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:34.077069 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:34.356826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a7197b2-f061-428e-a7f5-a376e06a91ef tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "POST /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298932 Sep 13 15:42:34.357444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 794/987] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:42:34 2022] POST /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:42:44.678140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:44.678952 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:42:44.683198 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:42:44.683816 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:44.691282 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:44.691743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:44.692170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:44.692859 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:44.693306 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:44.693727 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:44.719709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lazy-loading 'flavor' on Instance uuid 08572039-a710-40e6-bb3c-6fccc6fe5b41 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:42:44.812311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dc84a521-9ec9-49b0-b7db-bf57a4d01bf9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "POST /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41/action" status: 202 len: 0 microversion: 2.1 time: 0.135698 Sep 13 15:42:44.812902 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 795/988] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:42:44 2022] POST /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:42:44.821598 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:44.822324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:44.828695 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:44.829182 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:44.829696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:44.830423 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:44.830889 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:44.831310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:44.970326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:44.978747 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e7cee3f0-32f0-4ca9-ac6c-f418eeb9693a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.161220 Sep 13 15:42:44.979319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 796/989] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:44 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:46.006592 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:46.007750 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:46.014709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:46.015190 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:46.015619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:46.016316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:46.016754 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:46.017548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:46.419039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:46.426978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6ba0c70e-32ab-41f4-8d44-2f88fbad98b5 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.427034 Sep 13 15:42:46.427529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 797/990] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:45 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:47.451542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:47.452929 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:47.459481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:47.460005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:47.460438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:47.461132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:47.461582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:47.461972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:47.599612 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:47.608096 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1e06fff5-5968-4773-820c-b8c2464cbdf7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.160519 Sep 13 15:42:47.608669 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 798/991] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:47 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:42:48.631777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:48.632448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:48.639172 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:48.639659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:48.640088 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:48.640785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:48.641231 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:48.641634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:48.777725 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:48.789948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b6b6eeac-6f48-4459-b33d-23d761987c22 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.161832 Sep 13 15:42:48.790848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 799/992] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:48 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:49.816967 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:49.817691 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:49.826349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:49.827014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:49.827708 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:49.828684 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:49.829289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:49.829703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:49.990321 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:50.000567 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cc5e730e-045e-4d1d-beb7-1451f34e87e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.189373 Sep 13 15:42:50.001163 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 800/993] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:49 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:51.034392 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:51.035919 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:51.046809 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:51.047295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:51.047722 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:51.048630 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:51.049074 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:51.049500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:51.191966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:51.200336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-26fa3f9b-94b4-40b0-a69a-26eeb3874acd tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.175237 Sep 13 15:42:51.200916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 801/994] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:51 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:52.227680 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:52.228716 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:52.239625 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:52.240436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:52.241138 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:52.242408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:52.243125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:52.243815 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:52.386379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:52.394487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ac41f3c6-b6eb-4f81-b9f8-f3d4538dee24 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.173266 Sep 13 15:42:52.395059 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 802/995] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:52 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:53.420820 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:53.421528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:53.428377 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:53.428854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:53.429279 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:53.429965 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:53.430442 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:53.430854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:53.568325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:53.581003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a6b2ae3e-a491-4bf5-9059-b95a4474f3c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.165804 Sep 13 15:42:53.581545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 803/996] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:53 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:54.608977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:54.610502 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:54.617352 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:54.617839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:54.618307 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:54.618995 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:54.619452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:54.619876 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:54.765148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:54.773283 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-83e649bc-293a-422d-91c9-5bd188cefa2c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.170940 Sep 13 15:42:54.773849 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 804/997] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:54 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:55.801430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:55.802539 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:55.813316 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:55.813800 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:55.814278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:55.814985 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:55.815467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:55.815894 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:55.956277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:55.968662 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f158470-f6ce-49b9-b683-a9a3b638f34c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.174237 Sep 13 15:42:55.970234 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 805/998] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:55 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:56.997200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:56.998264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:57.009414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:57.010320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:57.011045 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:57.012099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:57.012851 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:57.013556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:57.159168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:57.167031 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-35cb142a-ec60-4945-b546-3e7f54ddd6f7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.176591 Sep 13 15:42:57.167599 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 806/999] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:56 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:58.190726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:58.191367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:58.198132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:58.198620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:58.199047 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:58.199731 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:58.200206 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:58.200621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:58.349097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:58.357104 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-31baa77f-41fd-4295-85a0-2f4f5320bffc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.170677 Sep 13 15:42:58.357998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 807/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:58 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:42:59.383262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:42:59.383917 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:42:59.390964 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:59.391450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:59.391880 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:59.393254 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:42:59.393726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:42:59.394146 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:42:59.537346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:42:59.550218 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0125d0a1-71d7-490b-977a-2442ad64ce31 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.170445 Sep 13 15:42:59.551144 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 808/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:42:59 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:00.582572 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:00.583314 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:00.591076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:00.591643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:00.592516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:00.593331 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:00.593860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:00.594419 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:00.615320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:00.738574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:00.746428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f3b9fadb-32cd-4712-9a71-83015570ac54 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.169915 Sep 13 15:43:00.747007 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 809/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:00 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:01.432102 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:01.432595 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:01.438913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:01.439415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:01.440295 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:01.440810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:01.441253 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:01.441668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:01.525383 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lazy-loading 'services' on Instance uuid 43addaa8-29a2-43dc-9f36-e315c06fa218 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:43:01.605982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0661040b-7822-4dec-84b7-07cfd126850b tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218/os-volume_attachments/8e7b7c29-1f1d-4b97-be68-b770dd665491" status: 202 len: 0 microversion: 2.1 time: 0.177614 Sep 13 15:43:01.606677 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 810/1003] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:43:01 2022] DELETE /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218/os-volume_attachments/8e7b7c29-1f1d-4b97-be68-b770dd665491 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:43:01.769627 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:01.770403 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:01.777448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:01.778039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:01.778429 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:01.779134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:01.779584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:01.779982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:01.917225 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:01.925755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ecb072d7-7526-43b4-938f-04c0609d82b6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.160412 Sep 13 15:43:01.926363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 811/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:01 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:02.749850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:02.750490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:02.757359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:02.757839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:02.758310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:02.759003 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:02.759451 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:02.759870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:02.785573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:43:02.871027 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3b2593e0-e7ba-469b-a81c-0722e8a6012f tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 204 len: 0 microversion: 2.1 time: 0.125082 Sep 13 15:43:02.871664 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 812/1005] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:43:02 2022] DELETE /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:43:02.880347 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:02.881039 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:02.887060 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:02.887540 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:02.887969 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:02.888658 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:02.889110 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:02.889530 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:03.037149 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:03.049441 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cec6edb3-7ce6-464e-b6cd-54b0fde92d01 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1513 microversion: 2.1 time: 0.172956 Sep 13 15:43:03.050006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 813/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:02 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:03.055343 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:03.055950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:03.061794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:03.062296 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:03.062719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:03.063394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:03.063841 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:03.064255 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:03.200703 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:03.212551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3cbec693-183b-4a90-b032-06e0bae220af tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.160541 Sep 13 15:43:03.213310 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 814/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:03 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:04.076989 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:04.078023 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:04.089671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:04.090548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:04.091264 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:04.092796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:04.093551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:04.094290 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:04.241862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:04.250131 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fb1658dc-a7bb-490d-a1ac-5c1d8f4b6fd5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1513 microversion: 2.1 time: 0.179844 Sep 13 15:43:04.250719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 815/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:04 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:04.256508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:04.257107 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:04.262853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:04.263323 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:04.263742 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:04.264424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:04.264864 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:04.265276 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:04.423508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:04.431822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e667da44-46b1-4246-b5d7-2e65416d3e81 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.179231 Sep 13 15:43:04.432389 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 816/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:04 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:05.273460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:05.274189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:05.281535 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:05.282034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:05.282507 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:05.283204 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:05.283653 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:05.284490 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:05.429093 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:05.436840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-992ab37b-6f27-4e49-ab51-17048333167e tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1513 microversion: 2.1 time: 0.167365 Sep 13 15:43:05.437404 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 817/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:05 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:05.456542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:05.457212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:05.465743 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:05.466488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:05.467054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:05.468160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:05.468639 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:05.469140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:05.662009 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:05.670508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ed54cc9c-c5c5-4f8f-8fde-ae86092d9cc9 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.218949 Sep 13 15:43:05.672597 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 818/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:05 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:06.104496 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-1e27be12-cf1c-4b01-b5c8-014b5450a857 req-fa055462-9382-492b-8d1a-80a162f566a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43addaa8-29a2-43dc-9f36-e315c06fa218", "name": "network-vif-deleted", "tag": "7e483d59-431a-4d8a-9a46-cac69ee3d82b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:06.114881 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1e27be12-cf1c-4b01-b5c8-014b5450a857 req-fa055462-9382-492b-8d1a-80a162f566a1 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.115354 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1e27be12-cf1c-4b01-b5c8-014b5450a857 req-fa055462-9382-492b-8d1a-80a162f566a1 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.115782 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1e27be12-cf1c-4b01-b5c8-014b5450a857 req-fa055462-9382-492b-8d1a-80a162f566a1 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.127430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-1e27be12-cf1c-4b01-b5c8-014b5450a857 req-fa055462-9382-492b-8d1a-80a162f566a1 service nova] Creating event network-vif-deleted:7e483d59-431a-4d8a-9a46-cac69ee3d82b for instance 43addaa8-29a2-43dc-9f36-e315c06fa218 on hv-cinder-85743 Sep 13 15:43:06.132953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-1e27be12-cf1c-4b01-b5c8-014b5450a857 req-fa055462-9382-492b-8d1a-80a162f566a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Sep 13 15:43:06.133596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 819/1012] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:43:06.466624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:06.468155 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:06.476142 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.476643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.477170 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.478433 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.479078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.479518 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.512328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.512712 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.513176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.513685 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lazy-loading 'fault' on Instance uuid 43addaa8-29a2-43dc-9f36-e315c06fa218 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:43:06.561622 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:06.570141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c4016d55-7843-428e-9d12-f8392066d0f4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 200 len: 1308 microversion: 2.1 time: 0.111740 Sep 13 15:43:06.570603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 820/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:06 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:06.694468 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:06.695099 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:06.701418 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.701895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.702359 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.703021 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.703487 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.703904 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.849156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:06.857207 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-586e6f1f-a8e8-4233-b629-42210f4e73e8 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1511 microversion: 2.1 time: 0.166781 Sep 13 15:43:06.857976 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 821/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:06 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:06.881081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:06.881692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:06.887775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.888265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.888698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.889386 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:06.889835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:06.890297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:06.922085 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120658) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 15:43:06.998544 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-29c6011a-8a3d-435a-9690-57b1ab46f76d tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "POST /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41/action" status: 202 len: 0 microversion: 2.1 time: 0.121905 Sep 13 15:43:06.999619 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 822/1015] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Sep 13 15:43:06 2022] POST /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 15:43:07.004601 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-51e02905-29b9-4da3-b06f-657de3681320 req-194d5e3c-b79d-43ac-a95c-dfb4e9f8506e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08572039-a710-40e6-bb3c-6fccc6fe5b41", "name": "network-vif-unplugged", "status": "completed", "tag": "8e967886-3ff8-4d58-9c31-aca6431f68e2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:07.014982 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-51e02905-29b9-4da3-b06f-657de3681320 req-194d5e3c-b79d-43ac-a95c-dfb4e9f8506e service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:07.015461 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-51e02905-29b9-4da3-b06f-657de3681320 req-194d5e3c-b79d-43ac-a95c-dfb4e9f8506e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:07.015866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-51e02905-29b9-4da3-b06f-657de3681320 req-194d5e3c-b79d-43ac-a95c-dfb4e9f8506e service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:07.020403 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:07.028517 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.compute.server_external_events [req-51e02905-29b9-4da3-b06f-657de3681320 req-194d5e3c-b79d-43ac-a95c-dfb4e9f8506e service nova] Unable to find a host for instance 08572039-a710-40e6-bb3c-6fccc6fe5b41. Dropping event network-vif-unplugged {{(pid=120658) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 15:43:07.029457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-51e02905-29b9-4da3-b06f-657de3681320 req-194d5e3c-b79d-43ac-a95c-dfb4e9f8506e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028792 Sep 13 15:43:07.030120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 823/1016] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 15:43:07.035531 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:07.036150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:07.043032 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:07.043524 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:07.043966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:07.044667 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:07.045123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:07.045551 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:07.230294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:07.238251 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0a399a4a-611b-456b-acbf-91d7ed3ac0dc tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1519 microversion: 2.1 time: 0.207020 Sep 13 15:43:07.238949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 824/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:07 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:07.593284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:07.593897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: 43addaa8-29a2-43dc-9f36-e315c06fa218] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:07.602636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:07.603125 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:07.603748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:07.604471 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:07.604921 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:07.605344 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:07.619978 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] HTTP exception thrown: Instance 43addaa8-29a2-43dc-9f36-e315c06fa218 could not be found. Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Request method failure captured: Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 HTTP/1.1 Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKTIPPPzzH57wgkiBNj37RgkO-F4t2ZHTVCh-DUOMYKo1z2UC2ySv3k_yTYaj8RqoRfXEOdfHfCIEgsff1P2W0Ji48TFpmPHJqv6Q1tnVq2-A5EClhjVdozi5Q2CDXqPyIwVfrr4aUMt10It4EwO_NEzcjSrCrkab8l-uvGgPAkgdOY Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: cb52082b3d6d4b4aab5cc9b9c2e86cb3 Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotTestJSON-509950869 Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:43:07.621694 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}] Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotTestJSON-509950869 Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: cb52082b3d6d4b4aab5cc9b9c2e86cb3 Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-509950869 Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotTestJSON-509950869-project Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 2b9bd416dc3447509ab5451d2c0b479f Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotTestJSON-509950869-project Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 43addaa8-29a2-43dc-9f36-e315c06fa218 could not be found. Sep 13 15:43:07.623401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '43addaa8-29a2-43dc-9f36-e315c06fa218'} Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43addaa8-29a2-43dc-9f36-e315c06fa218 could not be found. Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:43:07.624785 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43addaa8-29a2-43dc-9f36-e315c06fa218 could not be found. Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43addaa8-29a2-43dc-9f36-e315c06fa218 could not be found. Sep 13 15:43:07.626378 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:07.627794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Returning 404 to user: Instance 43addaa8-29a2-43dc-9f36-e315c06fa218 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:43:07.627794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f89eabf-a777-4573-a685-34d72b9d1254 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218" status: 404 len: 111 microversion: 2.1 time: 0.034121 Sep 13 15:43:07.627794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 825/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:07 2022] GET /compute/v2.1/servers/43addaa8-29a2-43dc-9f36-e315c06fa218 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:43:08.265533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:08.266406 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:08.275247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:08.275735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:08.276166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:08.276860 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:08.277313 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:08.277739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:08.415511 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:08.424545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5db18cd5-1fc4-4ef1-b78a-b0d13f005fa4 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1521 microversion: 2.1 time: 0.165670 Sep 13 15:43:08.425120 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 826/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:08 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:09.448812 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:09.450275 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:09.456755 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:09.457229 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:09.457654 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:09.458407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:09.459147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:09.459564 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:09.600465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:09.612226 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e1fe8a78-9b57-423d-86b8-328609133e4b tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.167053 Sep 13 15:43:09.613022 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 827/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:09 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:43:10.636212 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:10.636971 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:10.643868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:10.644358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:10.644792 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:10.645493 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:10.645966 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:10.646542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:10.782284 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:10.791315 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-39f2bd24-1f72-4201-9a93-cd5162d90e88 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.158982 Sep 13 15:43:10.791887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 828/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:10 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:43:11.814409 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:11.815108 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:11.821835 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:11.822437 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:11.822875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:11.823838 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:11.824297 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:11.824726 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:12.035760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:12.045614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1073c45a-c945-4d2a-acc0-91475c3f44ee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.235152 Sep 13 15:43:12.050180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 829/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:11 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:13.073762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:13.074358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:13.084037 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:13.085443 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:13.085883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:13.087040 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:13.087823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:13.088500 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:13.229189 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:13.237267 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d5aeb04-b811-4aec-b49f-b18484d19e4a tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.169900 Sep 13 15:43:13.237824 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 830/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:13 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:14.265263 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:14.266550 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:14.275415 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:14.275895 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:14.276320 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:14.277010 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:14.277459 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:14.277873 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:14.420766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:14.429078 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-640efe07-3284-41d4-92ea-df3c5e11b983 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.170276 Sep 13 15:43:14.429657 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 831/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:14 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:15.455411 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:15.456046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:15.459379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:15.465004 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:15.465488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:15.465912 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:15.466628 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:15.467073 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:15.467475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:15.612132 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:15.621856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-566c6b6b-07d3-4e7f-8ed1-adf57ed42aee tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.172613 Sep 13 15:43:15.622479 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 832/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:15 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:16.651081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:16.651879 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:16.662697 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:16.663294 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:16.663692 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:16.664395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:16.664850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:16.665277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:16.812634 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:16.821002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2d2c9b8c-a1d7-4dfc-aefe-3444cd6f99c2 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.177246 Sep 13 15:43:16.821575 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 833/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:16 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:17.557184 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1253083972", "imageRef": "f3b4a9bf-8c90-4257-a46c-a53d1361719b", "flavorRef": "452", "networks": [{"uuid": "cf36cbce-2ddc-4193-922d-7c2bf739a4cd"}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:17.613262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] validate_networks() for [('cf36cbce-2ddc-4193-922d-7c2bf739a4cd', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 15:43:17.983211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 15:43:17.983822 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 15:43:17.984082 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 15:43:17.984495 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 15:43:17.984905 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 15:43:17.994928 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:17.995428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:17.995839 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:17.996576 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:17.997034 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:17.997463 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:18.014390 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Getting quotas for project cb52082b3d6d4b4aab5cc9b9c2e86cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 15:43:18.018534 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Getting quotas for user 2b9bd416dc3447509ab5451d2c0b479f and project cb52082b3d6d4b4aab5cc9b9c2e86cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 15:43:18.031586 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 15:43:18.033914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3b4a9bf-8c90-4257-a46c-a53d1361719b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 15:43:18.094935 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e9acc3ea-cf72-415c-a20f-5ae9a7096f50 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541270 Sep 13 15:43:18.095916 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 834/1027] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 15:43:18.103033 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:18.103647 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:18.110636 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:18.111117 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:18.111543 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:18.112243 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:18.112688 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:18.113105 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:18.246197 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:18.254211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ce23b3cb-7807-41d5-b4cf-53132922ae3c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.156985 Sep 13 15:43:18.254768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 835/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:18 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:18.259914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1f1ddc98-25b9-40bf-a974-0f435b44f193 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:18.260519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1f1ddc98-25b9-40bf-a974-0f435b44f193 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:18.313682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1f1ddc98-25b9-40bf-a974-0f435b44f193 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:18.323768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1f1ddc98-25b9-40bf-a974-0f435b44f193 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1219 microversion: 2.1 time: 0.068014 Sep 13 15:43:18.324546 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 836/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:18 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:19.282379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:19.283481 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:19.293424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:19.293906 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:19.294374 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:19.295061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:19.295509 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:19.295926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:19.453796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:19.462621 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-63cbcb0b-3cbc-453c-8643-ec25f516d71f tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.186700 Sep 13 15:43:19.463450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 837/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:19 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:19.477810 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:19.478515 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:19.484751 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:19.485228 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:19.485666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:19.486545 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:19.487173 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:19.487596 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:19.548473 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:19.556627 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-715832da-3b75-46ed-ba5a-bef53f06ca9c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1223 microversion: 2.1 time: 0.083150 Sep 13 15:43:19.557248 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 838/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:19 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:20.486762 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:20.487436 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:20.494278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:20.494760 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:20.495211 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:20.495886 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:20.496333 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:20.496748 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:20.696583 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:20.704434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cc490ff9-a8ca-403c-ae9a-d8fe34591dcf tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.221733 Sep 13 15:43:20.705015 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 839/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:20 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:43:20.709456 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:20.710054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:20.722799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:20.723312 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:20.723766 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:20.724467 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:20.724914 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:20.725330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:20.798036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:20.806247 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ed8670bc-9ea7-4fa7-9a64-244ee483c517 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1277 microversion: 2.1 time: 0.099970 Sep 13 15:43:20.806896 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 840/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:20 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:21.728503 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:21.729115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:21.736508 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:21.736997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:21.737426 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:21.738140 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:21.738893 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:21.739309 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:21.944457 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:21.953417 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fac7f983-65b6-4ac7-b754-7dcf150b8caa tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.229117 Sep 13 15:43:21.954006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 841/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:21 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:21.958799 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:21.959394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:21.965614 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:21.966148 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:21.966568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:21.967238 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:21.967715 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:21.968134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:22.228556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:22.232019 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:22.237036 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-40df673f-a6a7-4f29-8b8b-731e57a46854 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.281912 Sep 13 15:43:22.237620 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 842/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:21 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:22.241977 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-8105435c-6847-4785-8c25-e9e30cdedd9c req-edbe09ed-b53a-4146-a60a-e3e60fbf8eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64475eb-7add-4bf3-ab8f-9b276295aea5", "tag": "8afbcd3f-eeeb-432c-8fe2-218390dfee57"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:22.252217 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8105435c-6847-4785-8c25-e9e30cdedd9c req-edbe09ed-b53a-4146-a60a-e3e60fbf8eb0 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:22.252668 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8105435c-6847-4785-8c25-e9e30cdedd9c req-edbe09ed-b53a-4146-a60a-e3e60fbf8eb0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:22.253325 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8105435c-6847-4785-8c25-e9e30cdedd9c req-edbe09ed-b53a-4146-a60a-e3e60fbf8eb0 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:22.264662 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-8105435c-6847-4785-8c25-e9e30cdedd9c req-edbe09ed-b53a-4146-a60a-e3e60fbf8eb0 service nova] Creating event network-changed:8afbcd3f-eeeb-432c-8fe2-218390dfee57 for instance e64475eb-7add-4bf3-ab8f-9b276295aea5 on hv-cinder-85743 Sep 13 15:43:22.269627 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-8105435c-6847-4785-8c25-e9e30cdedd9c req-edbe09ed-b53a-4146-a60a-e3e60fbf8eb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030905 Sep 13 15:43:22.270244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 843/1036] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:43:22.978277 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:22.978972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:22.985454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:22.985953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:22.986475 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:22.987164 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:22.987624 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:22.988054 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:23.131452 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:23.139878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d44cd292-7566-4644-a70d-a55159e43d6c tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.166516 Sep 13 15:43:23.140488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 844/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:22 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:23.144870 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-b28302c5-7753-43ce-b611-cc6eeb53a956 req-e353ce4b-595b-483c-99c4-cc18e7c6f055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08572039-a710-40e6-bb3c-6fccc6fe5b41", "name": "network-vif-plugged", "status": "completed", "tag": "8e967886-3ff8-4d58-9c31-aca6431f68e2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:23.154046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b28302c5-7753-43ce-b611-cc6eeb53a956 req-e353ce4b-595b-483c-99c4-cc18e7c6f055 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:23.154541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b28302c5-7753-43ce-b611-cc6eeb53a956 req-e353ce4b-595b-483c-99c4-cc18e7c6f055 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:23.154963 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b28302c5-7753-43ce-b611-cc6eeb53a956 req-e353ce4b-595b-483c-99c4-cc18e7c6f055 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:23.165874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-b28302c5-7753-43ce-b611-cc6eeb53a956 req-e353ce4b-595b-483c-99c4-cc18e7c6f055 service nova] Creating event network-vif-plugged:8e967886-3ff8-4d58-9c31-aca6431f68e2 for instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 on hv-cinder-85743 Sep 13 15:43:23.170770 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-b28302c5-7753-43ce-b611-cc6eeb53a956 req-e353ce4b-595b-483c-99c4-cc18e7c6f055 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029209 Sep 13 15:43:23.171346 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 845/1038] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:43:23.265008 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:23.266222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:23.275941 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:23.276428 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:23.276862 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:23.277556 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:23.278012 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:23.278469 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:23.411911 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:23.424181 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-64c91599-7c74-4ddc-8432-7afc872a20e2 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.165863 Sep 13 15:43:23.424897 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 846/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:23 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:24.168094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:24.169178 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:24.179953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:24.180853 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:24.181278 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:24.181961 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:24.182439 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:24.182856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:24.328796 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:24.339081 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c7e7e0f2-de23-4640-9862-1b88e1a204e7 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.177670 Sep 13 15:43:24.339652 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 847/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:24 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:24.451950 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:24.452840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:24.465358 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:24.466168 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:24.466988 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:24.468115 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:24.469319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:24.470156 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:24.643584 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:24.651696 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6946ad12-354d-43fa-89cd-4a038db91f1c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.207657 Sep 13 15:43:24.652476 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 848/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:24 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:25.362874 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:25.363489 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:25.370324 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:25.370784 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:25.371217 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:25.371913 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:25.372366 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:25.372791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:25.512444 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:25.524337 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-54289bcf-7b44-4bbb-b3b2-bfa0f2e2a2c1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1577 microversion: 2.1 time: 0.165183 Sep 13 15:43:25.524997 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 849/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:25 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:25.674878 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:25.675488 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:25.682301 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:25.682776 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:25.683203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:25.683885 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:25.684328 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:25.684745 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:25.831173 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:25.839516 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2003a706-96c1-49da-9a12-0396fbef6153 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.168600 Sep 13 15:43:25.840094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 850/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:25 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:26.548024 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:26.548663 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:26.555542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:26.556106 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:26.556533 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:26.557223 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:26.557670 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:26.558086 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:26.700926 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:26.713221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9e89ca7a-adaf-476d-ae98-afe3fb5b201e tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1564 microversion: 2.1 time: 0.168952 Sep 13 15:43:26.714222 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 851/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:26 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:26.868448 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:26.869367 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:26.877563 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:26.878239 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:26.878811 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:26.879719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:26.880339 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:26.880868 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:27.017030 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:27.026526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-70a053b3-f266-433d-b521-532ffe5cdd22 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.163253 Sep 13 15:43:27.027154 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 852/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:26 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:28.052141 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:28.052892 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:28.055682 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:28.061041 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:28.061525 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:28.061958 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:28.062687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:28.063139 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:28.063568 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:28.201398 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:28.209661 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-540482ad-67fd-4c59-863e-7540fea96cd4 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.162598 Sep 13 15:43:28.210262 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 853/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:28 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:29.233709 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:29.234369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:29.236220 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=8 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:29.242574 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:29.243061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:29.243491 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:29.244192 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:29.244643 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:29.245066 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:29.381326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:29.389631 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c5c8b33b-8fe5-4955-9fc8-5e26c764d3f5 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.160241 Sep 13 15:43:29.390230 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 854/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:29 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:29.394641 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-91de00c3-5bd0-4f88-a338-d3f4b5e10918 req-168536d9-de49-45d6-8103-5f0974b873c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64475eb-7add-4bf3-ab8f-9b276295aea5", "name": "network-vif-plugged", "status": "completed", "tag": "8afbcd3f-eeeb-432c-8fe2-218390dfee57"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:29.403974 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-91de00c3-5bd0-4f88-a338-d3f4b5e10918 req-168536d9-de49-45d6-8103-5f0974b873c7 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:29.404494 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-91de00c3-5bd0-4f88-a338-d3f4b5e10918 req-168536d9-de49-45d6-8103-5f0974b873c7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:29.404933 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-91de00c3-5bd0-4f88-a338-d3f4b5e10918 req-168536d9-de49-45d6-8103-5f0974b873c7 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:29.416293 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-91de00c3-5bd0-4f88-a338-d3f4b5e10918 req-168536d9-de49-45d6-8103-5f0974b873c7 service nova] Creating event network-vif-plugged:8afbcd3f-eeeb-432c-8fe2-218390dfee57 for instance e64475eb-7add-4bf3-ab8f-9b276295aea5 on hv-cinder-85743 Sep 13 15:43:29.421396 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-91de00c3-5bd0-4f88-a338-d3f4b5e10918 req-168536d9-de49-45d6-8103-5f0974b873c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030061 Sep 13 15:43:29.421940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 855/1048] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:43:30.415854 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:30.416689 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:30.423794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:30.424274 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:30.424704 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:30.425401 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:30.425848 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:30.426348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:30.557683 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:30.565738 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-99693480-eaac-43ae-aef4-9311871a513c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1319 microversion: 2.1 time: 0.155892 Sep 13 15:43:30.566349 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 856/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:30 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:31.592123 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:31.592898 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:31.600582 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:31.601087 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:31.601591 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:31.602394 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:31.602891 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:31.603363 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:31.742646 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:31.750959 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fa83cb41-241d-4308-a976-cb83ceecbbe6 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1508 microversion: 2.1 time: 0.164717 Sep 13 15:43:31.751506 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 857/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:31 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:31.782355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a14aca72-0f4a-4a24-a636-c1e607417a2e", "device": "/dev/sdb"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:31.784763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:31.790940 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:31.791424 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:31.791856 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:31.792573 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:31.793618 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:31.794044 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:32.067076 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-621497e3-543f-44f9-ad7b-91186746fc34 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "POST /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288217 Sep 13 15:43:32.067698 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 858/1051] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Sep 13 15:43:31 2022] POST /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:43:32.977301 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:43:32.978267 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:43:53.763200 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:53.763787 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:53.766558 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:53.767797 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:43:53.774355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:53.774923 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:53.775379 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:53.776077 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:53.776529 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:53.776948 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:53.864826 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lazy-loading 'services' on Instance uuid e64475eb-7add-4bf3-ab8f-9b276295aea5 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:43:53.945802 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5108a8eb-7003-498b-b98e-49fc085cc1b3 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5/os-volume_attachments/a14aca72-0f4a-4a24-a636-c1e607417a2e" status: 202 len: 0 microversion: 2.1 time: 0.186780 Sep 13 15:43:53.946570 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 859/1052] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Sep 13 15:43:53 2022] DELETE /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5/os-volume_attachments/a14aca72-0f4a-4a24-a636-c1e607417a2e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:43:55.088828 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:55.089523 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:55.096317 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:55.096814 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:55.097237 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:55.097996 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:55.098478 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:55.098899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:55.126430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:43:55.209395 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d9cf5f51-9e62-4fe0-a828-a5d1d72da70c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 204 len: 0 microversion: 2.1 time: 0.125317 Sep 13 15:43:55.210134 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 860/1053] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:43:55 2022] DELETE /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:43:55.219454 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:55.220147 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:55.226532 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:55.227014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:55.227763 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:55.228585 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:55.229233 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:55.229666 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:55.362097 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:55.374386 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bfa64a12-bd9a-48dc-8f60-f51f164e7d82 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1514 microversion: 2.1 time: 0.159242 Sep 13 15:43:55.375177 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 861/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:55 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:43:56.401580 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:56.402319 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:56.409299 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:56.409794 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:56.410249 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:56.410953 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:56.411397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:56.411813 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:56.543094 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:56.552616 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-549fa2c6-973f-435c-a607-f1b4ae4ada89 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1514 microversion: 2.1 time: 0.156574 Sep 13 15:43:56.553336 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 862/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:56 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:57.443980 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-86128052-4572-4832-825c-afce3f25c94b req-9c9ee2e3-be4e-4020-8919-ad1ce8c6b081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64475eb-7add-4bf3-ab8f-9b276295aea5", "name": "network-vif-deleted", "tag": "8afbcd3f-eeeb-432c-8fe2-218390dfee57"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:43:57.455369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-86128052-4572-4832-825c-afce3f25c94b req-9c9ee2e3-be4e-4020-8919-ad1ce8c6b081 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:57.455951 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-86128052-4572-4832-825c-afce3f25c94b req-9c9ee2e3-be4e-4020-8919-ad1ce8c6b081 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:57.456434 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-86128052-4572-4832-825c-afce3f25c94b req-9c9ee2e3-be4e-4020-8919-ad1ce8c6b081 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:57.468203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-86128052-4572-4832-825c-afce3f25c94b req-9c9ee2e3-be4e-4020-8919-ad1ce8c6b081 service nova] Creating event network-vif-deleted:8afbcd3f-eeeb-432c-8fe2-218390dfee57 for instance e64475eb-7add-4bf3-ab8f-9b276295aea5 on hv-cinder-85743 Sep 13 15:43:57.473672 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-86128052-4572-4832-825c-afce3f25c94b req-9c9ee2e3-be4e-4020-8919-ad1ce8c6b081 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Sep 13 15:43:57.474303 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 863/1056] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 15:43:57.577013 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:57.577720 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:57.584840 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:57.585330 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:57.585783 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:57.586501 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:57.587046 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:57.587453 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:57.619519 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:57.620005 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:57.620432 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:57.620875 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lazy-loading 'fault' on Instance uuid e64475eb-7add-4bf3-ab8f-9b276295aea5 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:43:57.665993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9bd416dc3447509ab5451d2c0b479f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb52082b3d6d4b4aab5cc9b9c2e86cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:43:57.673823 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-531ba634-1452-471a-923d-2ecd76e0263c tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 200 len: 1309 microversion: 2.1 time: 0.102271 Sep 13 15:43:57.674465 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 864/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:57 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:43:58.701414 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:43:58.702526 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] [instance: e64475eb-7add-4bf3-ab8f-9b276295aea5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:43:58.713289 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:58.713771 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:58.714245 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:58.714949 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:43:58.715403 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:43:58.715830 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:43:58.729775 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] HTTP exception thrown: Instance e64475eb-7add-4bf3-ab8f-9b276295aea5 could not be found. Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Request method failure captured: Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 HTTP/1.1 Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKTIPPPzzH57wgkiBNj37RgkO-F4t2ZHTVCh-DUOMYKo1z2UC2ySv3k_yTYaj8RqoRfXEOdfHfCIEgsff1P2W0Ji48TFpmPHJqv6Q1tnVq2-A5EClhjVdozi5Q2CDXqPyIwVfrr4aUMt10It4EwO_NEzcjSrCrkab8l-uvGgPAkgdOY Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: cb52082b3d6d4b4aab5cc9b9c2e86cb3 Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotTestJSON-509950869 Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:43:58.731472 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb52082b3d6d4b4aab5cc9b9c2e86cb3"}]}] Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotTestJSON-509950869 Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: cb52082b3d6d4b4aab5cc9b9c2e86cb3 Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-509950869 Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotTestJSON-509950869-project Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: 2b9bd416dc3447509ab5451d2c0b479f Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotTestJSON-509950869-project Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance e64475eb-7add-4bf3-ab8f-9b276295aea5 could not be found. Sep 13 15:43:58.733166 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': 'e64475eb-7add-4bf3-ab8f-9b276295aea5'} Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e64475eb-7add-4bf3-ab8f-9b276295aea5 could not be found. Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:43:58.734326 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e64475eb-7add-4bf3-ab8f-9b276295aea5 could not be found. Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e64475eb-7add-4bf3-ab8f-9b276295aea5 could not be found. Sep 13 15:43:58.735899 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:43:58.737483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] Returning 404 to user: Instance e64475eb-7add-4bf3-ab8f-9b276295aea5 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:43:58.737483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9a3deeb1-0b54-40d7-b529-cf24d8acb138 tempest-VolumesSnapshotTestJSON-509950869 tempest-VolumesSnapshotTestJSON-509950869-project] 10.222.0.16 "GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5" status: 404 len: 111 microversion: 2.1 time: 0.038194 Sep 13 15:43:58.737483 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 865/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:43:58 2022] GET /compute/v2.1/servers/e64475eb-7add-4bf3-ab8f-9b276295aea5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 15:45:09.659318 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:45:09.659821 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:45:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:45:12.136845 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:45:12.137883 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 15:45:12.142633 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:45:12.143193 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:45:12.151055 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:12.151791 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:12.152257 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:12.153002 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:12.153450 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:12.153866 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:12.180014 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 15:45:12.263438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8e222a76-535b-497d-a4d8-080a1b9d1826 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "DELETE /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 204 len: 0 microversion: 2.1 time: 0.128668 Sep 13 15:45:12.264438 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 866/1059] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Sep 13 15:45:12 2022] DELETE /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 15:45:12.274355 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-58f7111a-d5ee-4a54-b818-06882159d337 req-b17f4d79-6a02-43cd-b185-9f0b620e1d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08572039-a710-40e6-bb3c-6fccc6fe5b41", "tag": "8e967886-3ff8-4d58-9c31-aca6431f68e2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:45:12.284112 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-58f7111a-d5ee-4a54-b818-06882159d337 req-b17f4d79-6a02-43cd-b185-9f0b620e1d32 service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:12.284569 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-58f7111a-d5ee-4a54-b818-06882159d337 req-b17f4d79-6a02-43cd-b185-9f0b620e1d32 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:12.284990 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-58f7111a-d5ee-4a54-b818-06882159d337 req-b17f4d79-6a02-43cd-b185-9f0b620e1d32 service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:12.298777 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-58f7111a-d5ee-4a54-b818-06882159d337 req-b17f4d79-6a02-43cd-b185-9f0b620e1d32 service nova] Creating event network-changed:8e967886-3ff8-4d58-9c31-aca6431f68e2 for instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 on hv-cinder-85743 Sep 13 15:45:12.304879 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-58f7111a-d5ee-4a54-b818-06882159d337 req-b17f4d79-6a02-43cd-b185-9f0b620e1d32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038765 Sep 13 15:45:12.305528 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 867/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:45:12.310887 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:45:12.311579 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:45:12.317780 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:12.318291 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:12.318724 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:12.319408 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:12.319850 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:12.320265 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:12.578373 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:45:12.586440 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d95d8986-5380-47bd-b49e-d1b6e759a483 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.279660 Sep 13 15:45:12.587231 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 868/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:45:12 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:45:13.613259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:45:13.614011 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:45:13.621244 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:13.621728 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:13.622160 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:13.622900 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:13.623345 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:13.623768 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:13.820542 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:45:13.829659 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-27f023dc-3db4-45ee-8de5-e8f3083e8dc1 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1570 microversion: 2.1 time: 0.220385 Sep 13 15:45:13.830259 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 869/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:45:13 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 15:45:14.469268 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-d3f0f0d3-4ffb-4810-9d48-e1e77c54efa9 req-6038f5e0-e9eb-4703-839d-28391f26e96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08572039-a710-40e6-bb3c-6fccc6fe5b41", "name": "network-vif-deleted", "tag": "8e967886-3ff8-4d58-9c31-aca6431f68e2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 15:45:14.481194 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d3f0f0d3-4ffb-4810-9d48-e1e77c54efa9 req-6038f5e0-e9eb-4703-839d-28391f26e96c service nova] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:14.481735 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d3f0f0d3-4ffb-4810-9d48-e1e77c54efa9 req-6038f5e0-e9eb-4703-839d-28391f26e96c service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:14.482180 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d3f0f0d3-4ffb-4810-9d48-e1e77c54efa9 req-6038f5e0-e9eb-4703-839d-28391f26e96c service nova] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:14.493821 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-d3f0f0d3-4ffb-4810-9d48-e1e77c54efa9 req-6038f5e0-e9eb-4703-839d-28391f26e96c service nova] Creating event network-vif-deleted:8e967886-3ff8-4d58-9c31-aca6431f68e2 for instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 on hv-cinder-85743 Sep 13 15:45:14.499061 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-d3f0f0d3-4ffb-4810-9d48-e1e77c54efa9 req-6038f5e0-e9eb-4703-839d-28391f26e96c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096534 Sep 13 15:45:14.499687 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 870/1063] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Sep 13 15:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 15:45:14.855311 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:45:14.855998 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:45:14.864486 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:14.865221 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:14.865671 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:14.866739 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:14.867369 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:14.867993 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:14.900645 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:14.901122 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:14.901548 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:14.901983 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lazy-loading 'fault' on Instance uuid 08572039-a710-40e6-bb3c-6fccc6fe5b41 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 15:45:14.948719 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb98650b97664e0cbac0f574163b8c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb316ace93e48c68ade74e9c5fccbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 15:45:14.957348 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5dd024c1-9687-426c-8d98-677e40c6c421 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 200 len: 1225 microversion: 2.1 time: 0.107384 Sep 13 15:45:14.957939 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 871/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:45:14 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 15:45:15.986397 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:45:15.987186 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] [instance: 08572039-a710-40e6-bb3c-6fccc6fe5b41] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 15:45:15.995407 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:15.996006 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:15.996541 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:15.997555 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Acquiring lock "6341116c-714b-4fb7-baa1-e332de6a8c49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 15:45:15.998150 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 15:45:15.998804 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Lock "6341116c-714b-4fb7-baa1-e332de6a8c49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 15:45:16.016756 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] HTTP exception thrown: Instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 could not be found. Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Request method failure captured: Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 HTTP/1.1 Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Host: 10.222.0.16 Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIKQTQQx51BIq-euOA5AS_-70JPXAKZzbc7wzD3Vgy9beUn-JPw2ZiBBrNSmDazhpMEV1u-O5-ax5Y8INOBfuKlivXKT8-nOi08-jodIGTf0mpODytyGpbigLYOJLoj6BKqDoRoUCVq6iiNAqxR4u44r6WJ_zhT72xX3pGAFmDAXbCHM Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Id: 7eb316ace93e48c68ade74e9c5fccbf8 Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-TestShelveInstance-1380666457 Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Role: reader,member Sep 13 15:45:16.018460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Roles: reader,member Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eb316ace93e48c68ade74e9c5fccbf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7eb316ace93e48c68ade74e9c5fccbf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7eb316ace93e48c68ade74e9c5fccbf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eb316ace93e48c68ade74e9c5fccbf8"}]}] Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-TestShelveInstance-1380666457 Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 7eb316ace93e48c68ade74e9c5fccbf8 Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-TestShelveInstance-1380666457 Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User: tempest-TestShelveInstance-1380666457-project Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Id: cb98650b97664e0cbac0f574163b8c40 Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-TestShelveInstance-1380666457-project Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: method: > Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: exception: Instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 could not be found. Sep 13 15:45:16.020203 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: action_args: {'id': '08572039-a710-40e6-bb3c-6fccc6fe5b41'} Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 could not be found. Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 15:45:16.021176 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 could not be found. Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 could not be found. Sep 13 15:45:16.022972 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 15:45:16.024460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Returning 404 to user: Instance 08572039-a710-40e6-bb3c-6fccc6fe5b41 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:45:16.024460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8688fb4f-2f4a-4675-8d26-6012c04d72c6 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41" status: 404 len: 111 microversion: 2.1 time: 0.039087 Sep 13 15:45:16.024460 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 872/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Sep 13 15:45:15 2022] GET /compute/v2.1/servers/08572039-a710-40e6-bb3c-6fccc6fe5b41 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 15:45:16.188430 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-36f9ce25-222f-4e4f-a1b6-d5dd097acda3 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] Calling method '.version_select at 0x7f4bbf4c44c0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 15:45:16.214837 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-36f9ce25-222f-4e4f-a1b6-d5dd097acda3 tempest-TestShelveInstance-1380666457 tempest-TestShelveInstance-1380666457-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1900090519" status: 202 len: 0 microversion: 2.1 time: 0.030249 Sep 13 15:45:16.215603 dv-cinder-857434-2-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 873/1066] 10.222.0.16 () {58 vars in 1254 bytes} [Tue Sep 13 15:45:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1900090519 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 15:45:32.762394 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:45:32.763690 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:45:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:46:52.995945 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 15:46:52.997051 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:46:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:47:57.133973 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG neutronclient.v2_0.client [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=120659) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 13 15:47:57.134943 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack.requestlog [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.716364 Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack Traceback (most recent call last): Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack raise client_exc(message=error_message, Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-1810c7d1-ae92-451a-9515-8f4446fcc874'] Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack Traceback (most recent call last): Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return req.get_response(self.application) Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 13 15:47:57.193368 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack self._log_req(req, res, start) Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack self.force_reraise() Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack raise self.value Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack res = req.get_response(self.application) Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 13 15:47:57.195428 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return resp(environ, start_response) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return request.get_response(self.application) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack response = req.get_response(self._app) Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 13 15:47:57.197554 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return resp(environ, start_response) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return resp(environ, start_response) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack response = self.app(environ, start_response) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return resp(environ, start_response) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Sep 13 15:47:57.199983 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return method(req=request, **action_args) Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return f(*args, **kwargs) Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack [Previous line repeated 10 more times] Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self._create_instance( Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Sep 13 15:47:57.202743 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2626, in validate_networks Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ports_needed_per_instance = self._ports_needed_per_instance( Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2548, in _ports_needed_per_instance Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack nets = self._get_available_networks( Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 454, in _get_available_networks Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack nets = neutron.list_networks(**search_opts).get('networks', []) Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 860, in list_networks Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.list('networks', self.networks_path, retrieve_all, Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack res = self.get(path, params=params) Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 13 15:47:57.205686 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack raise exception.Unauthorized() Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova.api.openstack Sep 13 15:47:57.207796 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: INFO nova.api.openstack [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] http://10.222.0.16/compute/v2.1/servers returned with HTTP 401 Sep 13 15:47:57.209028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: DEBUG nova.api.openstack.wsgi [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=120659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 15:47:57.209028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:47:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 13 15:47:57.209028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: Tue Sep 13 15:47:57 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.16) Sep 13 15:47:57.209028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: CRITICAL nova [None req-735dedc0-299a-4972-83f2-b705c7f36258 tempest-TestVolumeBootPattern-1746934367 tempest-TestVolumeBootPattern-1746934367-project] Unhandled error: OSError: write error Sep 13 15:47:57.209028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova OSError: write error Sep 13 15:47:57.209028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: ERROR nova Sep 13 15:47:57.209028 dv-cinder-857434-2-iscsi devstack@n-api.service[120659]: [pid: 120659|app: 0|req: 194/1067] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Sep 13 15:32:56 2022] POST /compute/v2.1/servers => generated 0 bytes in 900779 msecs (HTTP/1.1 401) 9 headers in 0 bytes (1 switches on core 0)